-- Logs begin at Wed 2022-07-27 14:37:58 UTC, end at Wed 2022-07-27 15:47:43 UTC. -- Jul 27 15:19:53.170227 dv-cinder-841315-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 15:19:53.179396 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 15:19:53 2022] *** Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: nodename: dv-cinder-841315-2-iscsi Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: machine: x86_64 Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: clock source: unix Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: pcre jit disabled Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: detected number of CPU cores: 4 Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: current working directory: / Jul 27 15:19:53.181421 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: detected binary path: /usr/bin/uwsgi-core Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: your processes number limit is 47680 Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: your memory page size is 4096 bytes Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: detected max file descriptor number: 2048 Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: lock engine: pthread robust mutexes Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: thunder lock: enabled Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 15:19:53.182126 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 15:19:53.220617 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: Python main interpreter initialized at 0x5558d91de9c0 Jul 27 15:19:53.220617 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: python threads support enabled Jul 27 15:19:53.220617 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: your server socket listen backlog is limited to 100 connections Jul 27 15:19:53.220617 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: your mercy for graceful operations on workers is 90 seconds Jul 27 15:19:53.220956 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 15:19:53.220956 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: *** Operational MODE: preforking *** Jul 27 15:19:53.221214 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: *** uWSGI is running in multiple interpreter mode *** Jul 27 15:19:53.221214 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: spawned uWSGI master process (pid: 103186) Jul 27 15:19:53.221404 dv-cinder-841315-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 15:19:53.221943 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: spawned uWSGI worker 1 (pid: 103187, cores: 1) Jul 27 15:19:53.222750 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: spawned uWSGI worker 2 (pid: 103188, cores: 1) Jul 27 15:19:53.222750 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 15:19:53.873014 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 15:19:53.880686 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 15:19:54.947661 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:19:54.947661 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: from cryptography.utils import int_from_bytes Jul 27 15:19:54.948396 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:19:54.948396 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: from cryptography.utils import int_from_bytes Jul 27 15:19:54.948788 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:19:54.948788 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: from cryptography.utils import int_from_bytes Jul 27 15:19:54.948901 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:19:54.948901 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: from cryptography.utils import int_from_bytes Jul 27 15:19:57.390659 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:19:57.391201 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:19:57.391430 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:19:57.391791 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:19:57.391908 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:19:57.392003 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:19:57.392098 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:19:57.392241 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:19:57.392421 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.392604 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:19:57.392744 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.392861 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:19:57.393060 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.393250 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.393379 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.393577 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.393704 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.393898 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.393996 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.394217 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.394312 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.395084 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.395184 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.395393 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.395480 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.395702 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.395792 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396037 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396177 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396359 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-2-iscsi {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396444 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396617 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396707 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.396935 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397027 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397257 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397346 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-2-iscsi {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397569 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397659 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397868 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.397965 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.398175 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.398271 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.398473 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.398557 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.398779 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.398976 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.399100 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.399404 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.399522 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.399707 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.399931 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400058 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400239 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400384 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400546 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400702 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400853 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.400936 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.401160 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.401244 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.401479 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.401619 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.401787 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.401871 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.402106 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.402239 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.402414 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.402499 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-2-iscsi {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.402734 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.402860 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.403043 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.403136 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.403381 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.403473 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-2-iscsi {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.403754 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.403864 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.404106 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.404189 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.404455 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.404567 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.404720 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.404847 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405041 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405125 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405344 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405429 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405666 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405748 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.405982 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.406066 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.406295 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.406419 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.406609 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.406700 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.406907 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407001 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407212 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407303 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407515 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407598 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407821 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.407928 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408144 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408229 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408446 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408538 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408693 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408789 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.408996 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409315 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409414 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409580 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409671 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409888 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.409972 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.410757 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.410894 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411012 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411105 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411328 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411413 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411638 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411732 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.411914 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412005 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412237 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412332 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412546 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412642 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412849 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.412938 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.413150 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.413233 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.413451 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.413548 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.413754 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.413843 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414054 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414147 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414358 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414452 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414654 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414741 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.414955 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.415046 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.415254 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.415345 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.415568 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.415665 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.415906 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416010 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416215 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416306 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416519 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416606 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416854 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.416945 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.417150 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.417234 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.417457 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.417540 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.417769 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.417851 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418167 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418384 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418467 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418686 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418769 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.418985 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.419081 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.419296 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.419385 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.419601 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.419694 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.419928 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420017 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420174 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420256 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420473 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420569 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420773 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.420865 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421086 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421180 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421382 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421547 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421682 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421766 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.421982 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422066 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422278 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422371 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422579 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422673 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422878 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.422969 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.423174 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.423258 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.423471 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.423553 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.423772 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.423885 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.424095 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.424179 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.424394 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.424476 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.424699 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.424835 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425002 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425105 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425297 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425393 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425601 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425685 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.425924 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426008 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426226 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426310 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426528 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426622 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426829 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.426913 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.427130 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.427222 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.427432 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.427515 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.427732 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.427823 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428071 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428154 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428371 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428454 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428672 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428756 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.428985 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429074 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429285 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429379 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429584 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429667 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429899 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.429981 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.430196 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.430286 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.430496 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.430578 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.430804 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.430886 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.431102 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.431192 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.431401 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.431485 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.431701 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.431784 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432027 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432138 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432327 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432413 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432625 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432708 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.432921 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433016 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433219 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433302 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433514 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433596 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433813 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.433908 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.434113 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.434197 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.434412 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.434496 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.434712 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.434853 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.435014 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.435100 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.435324 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.435406 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.435627 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.435712 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.435955 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.436045 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.436273 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:19:57.436356 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.436607 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.436693 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.436932 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437029 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437258 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437350 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437573 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437656 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437881 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.437972 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.438192 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.438295 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.438514 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.438600 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.438820 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.438903 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.439126 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.439475 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.439687 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.439775 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440026 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440110 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440338 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440429 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440645 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440729 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.440962 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.441059 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.441272 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.441371 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.441612 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.441697 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.441920 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442003 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442232 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442391 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442550 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442634 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442861 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.442944 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.443167 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.443251 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.443490 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.443574 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.443809 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.443924 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.444141 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.444227 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.444468 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.444551 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.444785 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.444908 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.445094 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.445182 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.445401 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.445485 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.445707 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.445798 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446020 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446111 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446328 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446419 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446636 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446732 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.446949 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447032 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447259 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447344 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447568 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447659 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447892 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.447990 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.448200 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.448285 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.448507 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.448604 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.448816 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.448900 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.449126 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.449210 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.449434 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.449526 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.449742 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.449825 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450053 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450137 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450360 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450454 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450666 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450750 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.450969 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451052 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451270 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451355 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451570 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451655 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451894 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.451993 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.452201 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.452294 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.452499 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.452588 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.452798 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.452882 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.453107 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.453191 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.453410 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.453495 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.453729 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.453813 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454031 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454122 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454338 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454423 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454643 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454736 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.454950 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455077 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455253 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455336 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455557 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455653 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455882 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.455980 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.456186 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.456271 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.456493 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.456586 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.456796 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.456878 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.457614 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.457715 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.457990 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458095 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458234 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458319 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458534 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458617 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458857 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.458956 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.459145 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.459229 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.459450 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.459542 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.459754 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.459889 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.460087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.460174 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.460395 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.460477 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.460700 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.460790 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461006 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461089 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461329 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461413 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461640 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461732 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.461942 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462031 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462262 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462355 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462639 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462751 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462883 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.462973 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.463193 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.463308 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.463495 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.463580 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.463795 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.463901 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.464121 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.464218 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.464421 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.464506 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.464723 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.464807 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465021 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465154 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465316 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465408 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465613 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465698 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.465912 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.466003 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.466209 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.466298 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.466509 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.466592 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.466812 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467023 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467111 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467195 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467391 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467486 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467687 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.467778 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468023 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468109 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468325 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468409 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468629 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468722 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.468972 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469064 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469277 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469374 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469593 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469676 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469900 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.469990 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.470213 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.470305 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.470519 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.470603 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.470826 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.470911 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.471132 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.471293 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.471438 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.471531 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.471745 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.471860 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.472071 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.472173 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.472387 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.472478 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.473249 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.473346 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.473573 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.473658 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.473895 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.473980 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.474209 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.474284 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.474529 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.474602 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.474837 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.474911 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.475157 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.475238 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.475463 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.475538 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.475778 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.475879 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.476137 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.476224 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.476420 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.476496 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.476730 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.476803 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477036 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477110 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477344 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477430 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477651 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477734 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.477957 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478048 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478265 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478346 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478567 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478650 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478876 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.478968 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.479178 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.479268 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.479492 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.479576 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.479793 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.479909 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.480128 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.480212 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.480429 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.480512 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.480738 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.480831 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.481057 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.481263 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.481347 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.481661 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.481878 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.481996 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.482330 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.482453 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.482642 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.482954 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.483045 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.483275 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.483570 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.483653 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.483906 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.483993 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.484222 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.484307 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.484528 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.484619 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.484832 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.484923 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.485139 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.485222 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.485451 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.485532 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.485761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.485852 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486071 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486162 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486410 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486516 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486685 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486867 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.486995 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.487186 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.487281 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.487498 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.487589 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.487805 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.487935 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.488132 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.488217 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.488555 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.488836 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.488932 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.489136 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.489228 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.489478 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.489666 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.489785 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490005 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490091 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490336 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490420 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490649 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490746 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.490959 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.491045 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.491271 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.491422 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.491583 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.491728 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.492059 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.492154 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.492241 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.492540 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.492684 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.492860 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.493170 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.493254 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.493484 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.493768 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.493853 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.494089 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.494264 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.494410 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.494630 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.494714 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495019 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495199 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495330 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495530 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495641 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495865 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.495966 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.496187 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.496274 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.496506 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.496631 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.496818 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.496929 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.497143 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.497282 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.497460 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.497545 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.497765 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.497858 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.498073 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.498197 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.498381 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.498465 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.498692 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.498960 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.499055 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.499296 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.499388 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.499605 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.499697 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.499941 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500028 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500254 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500338 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500559 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500654 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500868 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.500960 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.501183 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.501275 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.501532 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.501751 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.501851 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.502083 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.502175 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.502400 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.502484 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.502720 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.502812 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503027 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503110 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503332 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503416 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503639 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503725 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.503996 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.504089 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.504308 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.504392 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.504615 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.504710 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.504918 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505004 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505221 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505312 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505525 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505628 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505834 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.505917 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.506136 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.506220 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.506437 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.506605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.506739 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.506823 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507044 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507128 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507346 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507438 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507648 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507733 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.507971 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508057 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508274 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508370 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508586 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508671 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508889 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.508973 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.509197 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.509282 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.509497 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.509582 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.509816 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.509915 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.510122 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.510215 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.510424 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.510509 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.510724 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.510808 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511026 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511112 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511341 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511431 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511645 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511729 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.511983 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512084 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512292 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512427 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512595 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512689 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512905 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.512991 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.513212 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.513296 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.513521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.513613 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.513823 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.513907 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.514122 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.514213 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.514423 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.514515 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.514722 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.514812 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515028 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515111 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515329 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515414 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515627 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515721 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.515951 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516037 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516261 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516347 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516564 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516691 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516863 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.516949 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.517167 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.517260 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.517466 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.517550 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.517774 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.517859 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518074 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518159 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518372 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518457 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518672 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518761 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.518977 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.519062 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.519280 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.519363 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.520136 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.520255 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.520443 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.520528 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.520744 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.520828 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521047 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521138 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521349 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521440 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521651 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521735 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.521976 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522121 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522253 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522338 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522559 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522643 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522860 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.522960 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.523187 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.523299 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.523493 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.523592 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.523797 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.523951 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.524123 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.524219 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.524424 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.524508 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.524727 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.524821 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525024 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525117 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525323 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525414 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525626 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525713 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.525927 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526012 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526231 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526317 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526533 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526627 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526834 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.526919 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.527135 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.527229 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.527437 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.527522 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.527737 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.527822 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528060 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528156 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528361 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528453 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528661 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528746 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.528962 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529059 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529262 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529346 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529581 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529666 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529887 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.529981 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.530189 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.530273 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.530490 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.530574 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.530791 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.530877 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.531095 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.531178 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.531408 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.531493 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.531718 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.531810 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532064 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532191 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532374 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532459 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532676 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532761 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.532983 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533066 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533291 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533374 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533599 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533903 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.533995 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.534215 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.534308 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.534522 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.534607 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.534831 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.534915 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.535259 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.535885 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.536080 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.536178 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.536388 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.536480 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.536697 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.536790 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537003 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537101 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537307 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537392 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537618 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537711 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.537925 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538018 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538225 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538316 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538530 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538615 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538833 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.538917 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.539135 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.539218 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.539439 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.539531 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.539740 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.539850 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540069 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540154 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540376 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540470 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540678 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540763 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.540982 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541066 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541281 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541365 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541580 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541672 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541880 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.541971 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.542180 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.542311 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.542480 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.542607 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.542800 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.542916 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.543104 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.543219 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.543405 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.543528 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.543708 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.543863 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.544034 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.544167 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.544340 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.544480 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.544638 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.544785 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545063 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545202 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545377 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545513 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545684 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545822 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.545986 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.546132 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.546292 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.546437 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.546598 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.546740 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.546907 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.547052 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.547222 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.547373 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.547521 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.547679 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.547964 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548052 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548272 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548357 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548577 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548664 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548882 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.548968 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.549183 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.549277 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.549483 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.549606 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.549787 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.549915 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.550106 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.550222 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.550406 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.550633 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.550718 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.550967 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.551061 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.551279 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.551365 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.551601 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.551693 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.551943 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552028 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552267 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552399 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552575 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552667 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552889 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.552983 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.553196 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.553331 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.553521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.553638 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.553843 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.553960 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.554153 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.554249 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.554464 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.554550 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.554768 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.554853 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.555088 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.555183 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.555407 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.555492 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.555719 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.555811 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.556066 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.556166 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.556385 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.556477 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.556691 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.556777 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557000 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557096 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557300 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557388 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557617 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557704 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.557936 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558022 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558245 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558338 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558561 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558646 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558866 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.558959 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.559172 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.559265 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.559494 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.559579 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.559799 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.559950 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.560134 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.560231 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.560446 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.560539 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.560754 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.560847 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561057 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561148 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561360 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561453 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561658 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561742 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.561970 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562062 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562275 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562376 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562584 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562673 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562894 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.562979 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.563201 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.563294 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.563505 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.563600 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.563803 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.563920 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.564143 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.564493 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.564696 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.564781 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.564998 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.565082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.565301 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.565387 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.565625 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.565708 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.565933 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566016 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566233 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566319 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566577 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566665 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566884 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.566975 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.567184 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.567270 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.567482 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.567567 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.567781 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.567885 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.568143 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.568230 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.568444 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.568528 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.568759 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.568853 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.569083 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.569168 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.569388 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.569473 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.569698 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.569793 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570003 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570092 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570307 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570392 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570610 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570704 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.570918 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571010 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571220 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571305 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571522 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571615 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571819 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.571964 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.572145 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.572230 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.572445 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.572578 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.572746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.572833 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573048 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573134 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573349 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573435 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573644 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573727 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.573943 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574028 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574240 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574326 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574556 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574640 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574854 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.574940 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.575177 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.575264 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.575482 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.575575 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.575782 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.575908 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.576106 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.576198 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.576405 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.576491 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.576741 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.576835 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577040 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577125 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577351 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577479 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577663 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577758 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.577975 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578061 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578287 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578372 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578591 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578895 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.578988 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.579204 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.579289 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.579510 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.579602 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.579819 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.579956 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.580149 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.580358 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.580517 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.580686 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.580772 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.580999 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.581085 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.581311 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.581410 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.581623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.581708 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.581929 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.582525 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.582755 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.582854 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.583064 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.583271 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.583358 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.583594 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.583698 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.583936 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584024 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584248 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584333 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584556 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584653 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584865 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.584951 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.585179 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.585271 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.585485 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.585580 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.585791 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.585879 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.586096 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.586188 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.586402 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.586490 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.586724 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.586817 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.587041 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.587128 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.587359 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.587444 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.587673 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.587757 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588009 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588109 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588320 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588406 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588630 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588713 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.588936 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589034 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589249 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589333 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589564 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589649 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589872 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.589964 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.590180 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.590264 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.590490 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.590573 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.590802 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.590887 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.591107 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.591199 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.591417 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.591503 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.591729 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.591819 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592063 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592151 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592370 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592456 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592678 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592801 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.592988 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.593192 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.593298 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.593506 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.593617 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.593840 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.593949 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.594164 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.594249 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.594488 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.594574 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.594806 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.594891 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.595124 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.595216 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.595448 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.595671 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.595756 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596007 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596095 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596339 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596434 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596659 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596743 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.596964 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.597049 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.597280 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.597366 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.597585 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.598268 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.598432 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.598518 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.598752 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.598838 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.599055 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.599147 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.599365 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.599588 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.599686 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.599961 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600050 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600283 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600370 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600588 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600673 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600890 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.600982 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.601204 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.601289 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.601510 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.601596 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.601833 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.602039 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.602128 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.602382 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.602477 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.602696 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.602781 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603018 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603102 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603323 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603420 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603629 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603714 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.603961 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604048 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604275 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604371 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604579 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604664 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604881 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.604964 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.605181 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.605266 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.605496 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.605580 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.605799 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.605883 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.606103 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.606187 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.606407 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.606493 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.606710 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.606794 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607011 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607095 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607314 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607397 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607616 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607711 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.607940 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608030 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608252 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608347 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608551 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608649 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608851 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.608943 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.609151 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.609236 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.609448 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.609541 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.609748 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.609833 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610050 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610136 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610351 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610509 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610658 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610743 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.610957 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611049 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611262 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611348 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611561 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611646 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611887 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.611974 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.612190 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.612277 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.612494 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.612578 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.612825 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.612909 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.613144 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.613254 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.613487 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.613573 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.613789 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614014 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614104 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614347 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614432 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614669 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614756 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.614993 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.615078 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.615298 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.615382 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.615614 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.615698 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.615945 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.616034 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.616251 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.616476 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.616563 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.616808 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.616903 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.617127 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.617212 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.617455 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.617540 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.617763 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.617855 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618073 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618169 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618373 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618457 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618676 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618765 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.618981 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.619066 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.619288 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.619381 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.619592 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.619676 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.619919 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620006 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620229 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620312 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620534 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620620 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620838 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.620931 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.621143 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.621237 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.621448 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.621539 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.621753 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.621838 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622058 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622157 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622363 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622457 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622667 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622764 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.622971 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.623102 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.623275 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.623359 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.623580 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.623663 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.623911 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624013 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624226 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624314 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624554 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624641 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624866 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.624951 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.625171 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.625256 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.625507 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.625594 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.625816 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.625902 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.626122 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.626207 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.626428 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.626521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.626738 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.626834 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.627065 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.627158 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.627377 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.627476 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.627680 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.627802 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.628022 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.628109 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.628332 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.628431 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.628659 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.628745 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629018 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629105 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629334 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629419 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629654 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629738 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.629956 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630040 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630260 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630346 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630564 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630657 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630870 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.630954 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.631183 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.631268 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.631491 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.631577 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.631796 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.631917 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.632123 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.632210 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.632430 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.632516 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.632731 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.632828 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633030 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633122 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633331 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633417 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633635 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633728 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.633938 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634028 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634236 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634320 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634532 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634624 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634831 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.634916 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.635132 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.635217 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.635428 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.635527 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.635726 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.635810 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636048 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636135 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636349 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636435 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636645 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636746 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.636980 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.637055 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.637282 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.637358 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.637645 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.637723 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.637955 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.638029 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.638297 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.638371 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.638611 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.638686 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.638910 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639063 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639211 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639293 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639540 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639625 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639858 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.639954 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.640159 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.640234 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.640489 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.640576 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.640848 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.640948 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.641110 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.641195 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.641425 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.641508 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.641732 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.641826 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642038 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642123 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642341 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642425 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642655 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642748 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.642965 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.643051 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.643273 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.643358 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.643578 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.643671 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.643925 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.644024 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.644232 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.644317 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645050 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645146 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645360 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645445 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645674 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645759 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.645983 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.646070 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.646291 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.646375 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.646613 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.646707 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.646921 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647006 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647227 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647311 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647536 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647628 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647866 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.647955 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.648182 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.648269 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.648491 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.648584 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.648799 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.648885 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.649105 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.649189 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.649420 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.649523 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.649729 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.649818 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650035 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650128 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650342 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650434 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650649 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650735 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.650961 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.651046 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.651266 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.651352 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.651573 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.651657 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.651910 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652011 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652225 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652311 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652549 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652636 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652872 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.652966 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.653177 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.653262 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.653483 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.653568 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.653727 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:19:57.653821 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.654137 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.654445 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.654783 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.655106 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.655416 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.655728 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.656057 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:19:57.656298 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:19:57.808697 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Registered counter for database nova_api Jul 27 15:19:57.808927 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Registered counter for database nova_api Jul 27 15:19:57.830851 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:57.833062 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:57.837940 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:57.841775 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:57.892548 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.context [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad4132ff-22fa-42e9-8152-725bc0f0dfda(cell1) {{(pid=103188) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:19:57.897040 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:19:57.898611 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:19:57.899413 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:19:57.899515 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.context [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad4132ff-22fa-42e9-8152-725bc0f0dfda(cell1) {{(pid=103187) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:19:57.901391 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:19:57.903349 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Registered counter for database nova_cell0 Jul 27 15:19:57.903454 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:19:57.904959 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:19:57.905739 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:19:57.907785 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:19:57.908694 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Registered counter for database nova_cell1 Jul 27 15:19:57.909771 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Registered counter for database nova_cell0 Jul 27 15:19:57.915378 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Registered counter for database nova_cell1 Jul 27 15:19:57.915751 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:57.917952 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:57.922188 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:57.922927 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:57.923397 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:57.925814 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:57.929381 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:57.934555 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:58.067931 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Registered counter for database nova_cell0 Jul 27 15:19:58.075044 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:58.079276 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:58.082628 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Registered counter for database nova_cell0 Jul 27 15:19:58.090112 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:19:58.094358 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:19:58.417680 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:19:58.418808 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:19:58.424838 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:19:58.425955 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:19:58.766471 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:19:58.772894 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:19:58.776345 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:19:58.778082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5558d91de9c0 pid: 103188 (default app) Jul 27 15:19:58.780176 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:58.781320 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jul 27 15:19:58.781726 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Jul 27 15:19:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:19:58.782201 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4808283c-4e30-445d-be49-4bfaf2fae52d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:19:58.787440 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5558d91de9c0 pid: 103187 (default app) Jul 27 15:21:14.200995 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:14.202654 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Jul 27 15:21:14.203304 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:14.215318 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=3 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:14.216299 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell1:SELECT=3 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:14.217939 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell0:SELECT=3 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:14.219085 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:15.068170 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b628a04d-403d-468b-b771-0698ed532b6b admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:15.101992 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b628a04d-403d-468b-b771-0698ed532b6b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891823 Jul 27 15:21:15.102763 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jul 27 15:21:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:17.305683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:17.306974 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5c8a5a00-9a1c-4574-a38e-48f529a99d4f None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jul 27 15:21:17.307593 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:17.801627 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d1b33d6f-bd62-4ac1-b3fa-1778c3eef4a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "swap": 0}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:17.822963 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:17.822963 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jul 27 15:21:17.849851 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d1b33d6f-bd62-4ac1-b3fa-1778c3eef4a5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533878 Jul 27 15:21:17.850596 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:17.864378 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=3 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:17.865748 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell1:SELECT=3 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:17.866805 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell0:SELECT=3 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:17.867810 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:18.084694 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-3026a10a-921b-4e9f-9f0f-6789c05dfe1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:18.090349 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:18.090349 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 27 15:21:18.157385 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-3026a10a-921b-4e9f-9f0f-6789c05dfe1a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298193 Jul 27 15:21:18.158180 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jul 27 15:21:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:20.405162 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d1b33d6f-bd62-4ac1-b3fa-1778c3eef4a5 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:20.406469 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d1b33d6f-bd62-4ac1-b3fa-1778c3eef4a5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 27 15:21:20.407099 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:21.060146 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-ab51cc8c-8d03-4c74-b6d1-8aadd5c67483 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:21.083802 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:21.083802 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 27 15:21:21.107927 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-ab51cc8c-8d03-4c74-b6d1-8aadd5c67483 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693671 Jul 27 15:21:21.108876 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:21.124573 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c218f34c-60bb-413b-ada5-00906d2d7b6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:21.127413 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:21.127413 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jul 27 15:21:21.164728 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c218f34c-60bb-413b-ada5-00906d2d7b6a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044043 Jul 27 15:21:21.176087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jul 27 15:21:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:23.455615 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-ab51cc8c-8d03-4c74-b6d1-8aadd5c67483 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:23.456764 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-ab51cc8c-8d03-4c74-b6d1-8aadd5c67483 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jul 27 15:21:23.457272 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:23.854527 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-8ef608dc-3c96-44ed-9052-611092af7498 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "vcpus": 1, "ram": 1024, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:23.873933 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-8ef608dc-3c96-44ed-9052-611092af7498 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410755 Jul 27 15:21:23.874467 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:23.886417 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-e96bef57-a7ff-4bba-9af9-385c863c4deb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:23.909624 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-e96bef57-a7ff-4bba-9af9-385c863c4deb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026881 Jul 27 15:21:23.910209 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jul 27 15:21:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:26.125173 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-8ef608dc-3c96-44ed-9052-611092af7498 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:26.126122 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-8ef608dc-3c96-44ed-9052-611092af7498 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 27 15:21:26.126526 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:26.563893 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5c3d9dcc-af95-44be-9983-03583fae3091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:26.586713 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5c3d9dcc-af95-44be-9983-03583fae3091 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454109 Jul 27 15:21:26.587983 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:26.603216 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-84c7d61b-1bee-4dd0-9bb8-26d1147bd72e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:26.634904 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-84c7d61b-1bee-4dd0-9bb8-26d1147bd72e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035333 Jul 27 15:21:26.636121 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jul 27 15:21:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:28.834720 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5c3d9dcc-af95-44be-9983-03583fae3091 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:28.835729 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5c3d9dcc-af95-44be-9983-03583fae3091 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 27 15:21:28.836308 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:29.270555 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-68614334-18bd-4c14-983e-eac2ed1e6271 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:29.290163 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-68614334-18bd-4c14-983e-eac2ed1e6271 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447573 Jul 27 15:21:29.291061 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:29.303233 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-24c7a200-e653-48da-9881-a0870059f25c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:29.329611 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-24c7a200-e653-48da-9881-a0870059f25c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030481 Jul 27 15:21:29.330407 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jul 27 15:21:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:31.551340 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-68614334-18bd-4c14-983e-eac2ed1e6271 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:31.552467 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-68614334-18bd-4c14-983e-eac2ed1e6271 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 27 15:21:31.552833 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:21:31.995751 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-60054240-0499-43bc-9cb5-4a7cc66396d0 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:32.020974 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-60054240-0499-43bc-9cb5-4a7cc66396d0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.462147 Jul 27 15:21:32.021520 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jul 27 15:21:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:21:34.366265 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-68614334-18bd-4c14-983e-eac2ed1e6271 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:34.367534 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-68614334-18bd-4c14-983e-eac2ed1e6271 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jul 27 15:21:34.368114 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:34.833990 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-f34bbc57-0b66-4b82-9eef-d116d84627e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:34.854385 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-f34bbc57-0b66-4b82-9eef-d116d84627e1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.478782 Jul 27 15:21:34.855280 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:34.874520 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-4bea088e-9231-43c9-a5b8-69d4a3729be1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:34.901726 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-4bea088e-9231-43c9-a5b8-69d4a3729be1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036411 Jul 27 15:21:34.902323 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jul 27 15:21:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:37.170007 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-f34bbc57-0b66-4b82-9eef-d116d84627e1 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:37.171012 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-f34bbc57-0b66-4b82-9eef-d116d84627e1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 27 15:21:37.171409 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:37.568835 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-1eb4f8e8-2282-42ad-99bf-3e83a38fadcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "disk": 20}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:37.587448 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-1eb4f8e8-2282-42ad-99bf-3e83a38fadcb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410346 Jul 27 15:21:37.588029 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:37.599887 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-eb8ff2ce-6e21-4090-9f89-a2e6276888a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:37.624460 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-eb8ff2ce-6e21-4090-9f89-a2e6276888a7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028009 Jul 27 15:21:37.625038 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jul 27 15:21:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:39.804234 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-1eb4f8e8-2282-42ad-99bf-3e83a38fadcb admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:39.805275 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-1eb4f8e8-2282-42ad-99bf-3e83a38fadcb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 27 15:21:39.805683 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:40.210888 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-ba1f9155-face-496e-ade4-7e1052a33660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "disk": 40, "swap": 0}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:40.230860 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-ba1f9155-face-496e-ade4-7e1052a33660 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.418333 Jul 27 15:21:40.231423 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:40.243606 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-31eea829-3c2e-40c5-89d2-280781c35225 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:40.269615 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-31eea829-3c2e-40c5-89d2-280781c35225 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029814 Jul 27 15:21:40.270202 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jul 27 15:21:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:42.501813 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-ba1f9155-face-496e-ade4-7e1052a33660 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:42.502955 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-ba1f9155-face-496e-ade4-7e1052a33660 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 27 15:21:42.503309 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:42.948902 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-47331043-8d7b-472b-ad46-e60f7fdf583b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "ram": 8192}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:42.983237 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-47331043-8d7b-472b-ad46-e60f7fdf583b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473814 Jul 27 15:21:42.983796 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:42.995376 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-f0cd39e8-87b3-4276-80f0-80ebc4656d86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:43.023339 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-f0cd39e8-87b3-4276-80f0-80ebc4656d86 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031541 Jul 27 15:21:43.024217 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jul 27 15:21:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:45.289951 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-47331043-8d7b-472b-ad46-e60f7fdf583b admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:45.290963 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-47331043-8d7b-472b-ad46-e60f7fdf583b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 27 15:21:45.291969 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:21:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:45.810069 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-01355f45-20fd-4ee6-917a-f56307fc1e03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:45.835442 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-01355f45-20fd-4ee6-917a-f56307fc1e03 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.538157 Jul 27 15:21:45.843355 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jul 27 15:21:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:21:45.848705 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c9a3350b-5357-4edb-b619-5ed375837566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:45.857094 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:45.879249 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c9a3350b-5357-4edb-b619-5ed375837566 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034212 Jul 27 15:21:45.879817 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jul 27 15:21:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:05.265039 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-01355f45-20fd-4ee6-917a-f56307fc1e03 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:05.266096 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-01355f45-20fd-4ee6-917a-f56307fc1e03 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 27 15:22:05.266497 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:05.276973 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:22:05.651876 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-def33691-25a5-42b5-9caf-79bc62c3e1a6 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:05.669988 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-def33691-25a5-42b5-9caf-79bc62c3e1a6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397541 Jul 27 15:22:05.670513 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jul 27 15:22:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:06.734382 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-01355f45-20fd-4ee6-917a-f56307fc1e03 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:06.735417 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-01355f45-20fd-4ee6-917a-f56307fc1e03 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 27 15:22:06.735813 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:07.252452 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-7237a996-fd07-41d1-b440-9c188fb24805 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:07.258122 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.wsgi [None req-7237a996-fd07-41d1-b440-9c188fb24805 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-7237a996-fd07-41d1-b440-9c188fb24805 admin admin] Request method failure captured: Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Accept: application/json Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Accept-Encoding: gzip, deflate Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Connection: keep-alive Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Content-Length: 0 Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Host: 10.222.0.36 Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Openstack-Api-Version: compute 2.90 Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Openstack-System-Scope: None Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: User-Agent: python-novaclient Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Auth-Token: gAAAAABi4VgeiN2-a2jabJtdtrXHNKoq6yxd4LkUDFrbISOsXvLxyUyiR3wHEhZ8-s-I9BzIWTvA60L_t_9ioaDQwmmmz8y8F-KsdIsP6PC0lJZhkYkngstQiJ83HClU0sKThj2_q5FHOSei4s9nMkuBgjzC4_twepRHTooTzf_QI4i7yar0Uus Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Domain-Id: None Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Domain-Name: None Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Identity-Status: Confirmed Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Is-Admin-Project: True Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Domain-Id: default Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Domain-Name: Default Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Name: admin Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Role: admin,reader,member Jul 27 15:22:07.261380 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Roles: admin,reader,member Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1de4e10bc0744aea22a689aefa058d1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant: admin Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant-Name: admin Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User: admin Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Domain-Id: default Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Domain-Name: Default Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Id: feddce10ac514a48a58f8b731d31a20b Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Name: admin Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: method: > Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: exception: Flavor 42 could not be found. Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: action_args: {'id': '42'} Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:22:07.263390 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:07.264308 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.265652 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-7237a996-fd07-41d1-b440-9c188fb24805 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:22:07.266953 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-7237a996-fd07-41d1-b440-9c188fb24805 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390073 Jul 27 15:22:07.266953 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jul 27 15:22:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:07.273031 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-f708b4bc-e55c-4e44-a675-40cf94c29934 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:07.277208 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:22:07.296756 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-f708b4bc-e55c-4e44-a675-40cf94c29934 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027297 Jul 27 15:22:07.297301 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jul 27 15:22:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:07.306946 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-f105b3fd-9934-493f-bb6f-d07c70543c6a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:07.331254 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-f105b3fd-9934-493f-bb6f-d07c70543c6a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027862 Jul 27 15:22:07.331803 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jul 27 15:22:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:07.342168 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-836a0178-15f2-4171-95e5-014987b3166e admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:07.349024 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.wsgi [None req-836a0178-15f2-4171-95e5-014987b3166e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-836a0178-15f2-4171-95e5-014987b3166e admin admin] Request method failure captured: Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Accept: application/json Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Accept-Encoding: gzip, deflate Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Connection: keep-alive Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Content-Length: 0 Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Host: 10.222.0.36 Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Openstack-Api-Version: compute 2.90 Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Openstack-System-Scope: None Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: User-Agent: python-novaclient Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Auth-Token: gAAAAABi4VgeiN2-a2jabJtdtrXHNKoq6yxd4LkUDFrbISOsXvLxyUyiR3wHEhZ8-s-I9BzIWTvA60L_t_9ioaDQwmmmz8y8F-KsdIsP6PC0lJZhkYkngstQiJ83HClU0sKThj2_q5FHOSei4s9nMkuBgjzC4_twepRHTooTzf_QI4i7yar0Uus Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Domain-Id: None Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Domain-Name: None Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Identity-Status: Confirmed Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Is-Admin-Project: True Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Domain-Id: default Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Domain-Name: Default Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Name: admin Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Role: admin,reader,member Jul 27 15:22:07.353082 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Roles: admin,reader,member Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1de4e10bc0744aea22a689aefa058d1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant: admin Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant-Name: admin Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User: admin Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Domain-Id: default Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Domain-Name: Default Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Id: feddce10ac514a48a58f8b731d31a20b Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Name: admin Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: method: > Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: exception: Flavor 42 could not be found. Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: action_args: {'id': '42'} Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:22:07.354623 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:07.355605 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:07.356986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-836a0178-15f2-4171-95e5-014987b3166e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:22:07.358227 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-836a0178-15f2-4171-95e5-014987b3166e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016884 Jul 27 15:22:07.358227 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jul 27 15:22:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 15:22:08.308829 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-f105b3fd-9934-493f-bb6f-d07c70543c6a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.309908 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-f105b3fd-9934-493f-bb6f-d07c70543c6a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 27 15:22:08.310381 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:08.824218 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-296c5b5a-c4d7-4b8a-bf3e-704b91eb5222 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.829506 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.wsgi [None req-296c5b5a-c4d7-4b8a-bf3e-704b91eb5222 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-296c5b5a-c4d7-4b8a-bf3e-704b91eb5222 admin admin] Request method failure captured: Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Accept: application/json Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Accept-Encoding: gzip, deflate Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Connection: keep-alive Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Content-Length: 0 Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Host: 10.222.0.36 Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Openstack-Api-Version: compute 2.90 Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Openstack-System-Scope: None Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: User-Agent: python-novaclient Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Auth-Token: gAAAAABi4Vgg_j58iXIGXPpnGAQ_ldWX3keN29mn1zaXdm7kQf7lUjjDKRIdFO1KsyNDmqcX_DgMsq9QiWPcTVgeoCCr57W2MlV_Gb-KLCSV-Cy5PSoMQqbsFCaClipFGoajAGTekrLk9unAtyTc5acsruZ_m8m4u6ETM37iCOt13izhS9YYb7k Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Domain-Id: None Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Domain-Name: None Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Identity-Status: Confirmed Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Is-Admin-Project: True Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Domain-Id: default Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Domain-Name: Default Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Name: admin Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Role: admin,reader,member Jul 27 15:22:08.830991 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Roles: admin,reader,member Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1de4e10bc0744aea22a689aefa058d1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant: admin Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant-Name: admin Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User: admin Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Domain-Id: default Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Domain-Name: Default Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Id: feddce10ac514a48a58f8b731d31a20b Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Name: admin Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: method: > Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: exception: Flavor 84 could not be found. Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: action_args: {'id': '84'} Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:22:08.832521 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:08.833422 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.834683 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-296c5b5a-c4d7-4b8a-bf3e-704b91eb5222 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:22:08.835900 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-296c5b5a-c4d7-4b8a-bf3e-704b91eb5222 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384933 Jul 27 15:22:08.835900 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jul 27 15:22:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:08.842026 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d51a4c17-97ed-411c-a31b-b8c8303a1b47 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.857205 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d51a4c17-97ed-411c-a31b-b8c8303a1b47 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018661 Jul 27 15:22:08.857662 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jul 27 15:22:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:08.866672 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-a2955fac-bdf9-451f-b0b2-676aa464c810 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.881930 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-a2955fac-bdf9-451f-b0b2-676aa464c810 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018673 Jul 27 15:22:08.882487 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jul 27 15:22:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:08.891415 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-096e3955-33ec-4200-95e6-3d230bbead8a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.896602 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.wsgi [None req-096e3955-33ec-4200-95e6-3d230bbead8a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-096e3955-33ec-4200-95e6-3d230bbead8a admin admin] Request method failure captured: Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Accept: application/json Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Accept-Encoding: gzip, deflate Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Connection: keep-alive Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Content-Length: 0 Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Host: 10.222.0.36 Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Openstack-Api-Version: compute 2.90 Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Openstack-System-Scope: None Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: User-Agent: python-novaclient Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Auth-Token: gAAAAABi4Vgg_j58iXIGXPpnGAQ_ldWX3keN29mn1zaXdm7kQf7lUjjDKRIdFO1KsyNDmqcX_DgMsq9QiWPcTVgeoCCr57W2MlV_Gb-KLCSV-Cy5PSoMQqbsFCaClipFGoajAGTekrLk9unAtyTc5acsruZ_m8m4u6ETM37iCOt13izhS9YYb7k Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Domain-Id: None Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Domain-Name: None Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Identity-Status: Confirmed Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Is-Admin-Project: True Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Domain-Id: default Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Domain-Name: Default Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Name: admin Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Role: admin,reader,member Jul 27 15:22:08.898082 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Roles: admin,reader,member Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1de4e10bc0744aea22a689aefa058d1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant: admin Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant-Name: admin Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User: admin Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Domain-Id: default Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Domain-Name: Default Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Id: feddce10ac514a48a58f8b731d31a20b Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Name: admin Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: method: > Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: exception: Flavor 84 could not be found. Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: action_args: {'id': '84'} Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:22:08.899679 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:08.900839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:08.902155 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-096e3955-33ec-4200-95e6-3d230bbead8a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:22:08.903359 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-096e3955-33ec-4200-95e6-3d230bbead8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011442 Jul 27 15:22:08.903359 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jul 27 15:22:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:09.857088 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-a2955fac-bdf9-451f-b0b2-676aa464c810 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:09.858102 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-a2955fac-bdf9-451f-b0b2-676aa464c810 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 27 15:22:09.858497 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:10.377839 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-ee31e07a-0cc8-426e-a47f-08bef0eb0645 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.383536 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.wsgi [None req-ee31e07a-0cc8-426e-a47f-08bef0eb0645 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-ee31e07a-0cc8-426e-a47f-08bef0eb0645 admin admin] Request method failure captured: Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Accept: application/json Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Accept-Encoding: gzip, deflate Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Connection: keep-alive Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Content-Length: 0 Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Host: 10.222.0.36 Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Openstack-Api-Version: compute 2.90 Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Openstack-System-Scope: None Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: User-Agent: python-novaclient Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Auth-Token: gAAAAABi4VghlId5i8W9abhciD1k1x3OmmPUmCtoRK5aajgH9QnpRq76vu_rsuxkFdoaZ0Vgip2mTMZjHKb0OQXZMy4fr5XbFXjNM-azh6bG3hWK5-FSs2qE4IGqFtt-bqUi3iTHxp48PRAubkpIqTHihyVAW8jZLgZZ-D-vRXw3sr1M9GFTDkc Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Domain-Id: None Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Domain-Name: None Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Identity-Status: Confirmed Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Is-Admin-Project: True Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Domain-Id: default Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Domain-Name: Default Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Project-Name: admin Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Role: admin,reader,member Jul 27 15:22:10.385087 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Roles: admin,reader,member Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1de4e10bc0744aea22a689aefa058d1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant: admin Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-Tenant-Name: admin Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User: admin Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Domain-Id: default Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Domain-Name: Default Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Id: feddce10ac514a48a58f8b731d31a20b Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: X-User-Name: admin Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: method: > Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: exception: Flavor 451 could not be found. Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: action_args: {'id': '451'} Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:22:10.386746 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:10.388560 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.389660 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-ee31e07a-0cc8-426e-a47f-08bef0eb0645 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:22:10.390692 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-ee31e07a-0cc8-426e-a47f-08bef0eb0645 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391289 Jul 27 15:22:10.390692 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jul 27 15:22:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:10.396253 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-011ba746-f2ab-42c5-bc99-cb10e067df0e admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.410933 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-011ba746-f2ab-42c5-bc99-cb10e067df0e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018350 Jul 27 15:22:10.411449 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jul 27 15:22:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:10.421264 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.436726 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019511 Jul 27 15:22:10.437240 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jul 27 15:22:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:10.446118 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-533b7e98-5539-4663-8f32-b3339b90ca4f admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.451242 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.wsgi [None req-533b7e98-5539-4663-8f32-b3339b90ca4f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-533b7e98-5539-4663-8f32-b3339b90ca4f admin admin] Request method failure captured: Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Accept: application/json Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Accept-Encoding: gzip, deflate Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Connection: keep-alive Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Content-Length: 0 Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Host: 10.222.0.36 Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Openstack-Api-Version: compute 2.90 Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Openstack-System-Scope: None Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: User-Agent: python-novaclient Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Auth-Token: gAAAAABi4VghlId5i8W9abhciD1k1x3OmmPUmCtoRK5aajgH9QnpRq76vu_rsuxkFdoaZ0Vgip2mTMZjHKb0OQXZMy4fr5XbFXjNM-azh6bG3hWK5-FSs2qE4IGqFtt-bqUi3iTHxp48PRAubkpIqTHihyVAW8jZLgZZ-D-vRXw3sr1M9GFTDkc Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Domain-Id: None Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Domain-Name: None Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Identity-Status: Confirmed Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Is-Admin-Project: True Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Domain-Id: default Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Domain-Name: Default Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Project-Name: admin Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Role: admin,reader,member Jul 27 15:22:10.452761 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Roles: admin,reader,member Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1de4e10bc0744aea22a689aefa058d1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1de4e10bc0744aea22a689aefa058d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant: admin Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant-Id: c1de4e10bc0744aea22a689aefa058d1 Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-Tenant-Name: admin Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User: admin Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Domain-Id: default Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Domain-Name: Default Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Id: feddce10ac514a48a58f8b731d31a20b Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: X-User-Name: admin Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: method: > Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: exception: Flavor 451 could not be found. Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: action_args: {'id': '451'} Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:22:10.454247 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:10.455086 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 27 15:22:10.456131 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-533b7e98-5539-4663-8f32-b3339b90ca4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:22:10.457123 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-533b7e98-5539-4663-8f32-b3339b90ca4f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011489 Jul 27 15:22:10.457123 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jul 27 15:22:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:11.408104 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:11.409105 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 27 15:22:11.409493 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:11.932607 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-42cf1c4a-7aa8-44ae-9e67-2a8b2467e303 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:11.952293 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-42cf1c4a-7aa8-44ae-9e67-2a8b2467e303 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405843 Jul 27 15:22:11.952925 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jul 27 15:22:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:12.905033 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:12.906090 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 27 15:22:12.906482 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:13.425863 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-600133ff-d794-429f-92b0-04ee62bed8b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:13.444398 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-600133ff-d794-429f-92b0-04ee62bed8b4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401708 Jul 27 15:22:13.444971 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jul 27 15:22:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:14.400838 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:14.401861 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 27 15:22:14.402288 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:14.919774 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5091c464-6e3c-4d37-8dbd-a58ff8253a97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:14.938374 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5091c464-6e3c-4d37-8dbd-a58ff8253a97 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398385 Jul 27 15:22:14.938900 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jul 27 15:22:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:15.901077 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:15.902086 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 27 15:22:15.902475 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:16.427543 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-e2201098-a89b-4052-b45a-6ca1d951898f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:16.446681 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-e2201098-a89b-4052-b45a-6ca1d951898f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405879 Jul 27 15:22:16.447222 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jul 27 15:22:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:17.418539 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:17.420168 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jul 27 15:22:17.420568 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:17.940387 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d9708889-da67-4979-a576-13043e959b08 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:17.961152 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d9708889-da67-4979-a576-13043e959b08 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404744 Jul 27 15:22:17.961777 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Jul 27 15:22:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:23:08.821706 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:08.822708 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b56baa33-6233-4f57-86bf-002740f4f6b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 27 15:23:08.823094 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jul 27 15:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:08.833796 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:23:09.211879 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-47839103-679f-4562-833e-32e7d02e29f9 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.231929 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-47839103-679f-4562-833e-32e7d02e29f9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402496 Jul 27 15:23:09.232419 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jul 27 15:23:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:23:09.255517 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-9d9e4ede-9354-4727-84d9-a9d6790dde0f admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.258926 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=14 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:23:09.264515 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-9d9e4ede-9354-4727-84d9-a9d6790dde0f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012570 Jul 27 15:23:09.265631 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Jul 27 15:23:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:09.277192 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-c76ffc89-c8bd-43ba-804a-b60c89604220 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.284740 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-c76ffc89-c8bd-43ba-804a-b60c89604220 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011105 Jul 27 15:23:09.285258 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Jul 27 15:23:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:09.296216 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.303755 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010994 Jul 27 15:23:09.304313 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Jul 27 15:23:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:09.316300 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-21eeb225-9a64-4207-b3df-330dad6e1f40 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.323851 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-21eeb225-9a64-4207-b3df-330dad6e1f40 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011863 Jul 27 15:23:09.324368 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Jul 27 15:23:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:26:28.993519 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:28.994534 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 27 15:26:28.994944 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:29.138952 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=6 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:29.296166 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-2cb30a39-796b-499d-9971-b8981247eaab admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:29.298528 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:29.298528 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 27 15:26:29.299774 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2cb30a39-796b-499d-9971-b8981247eaab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:29.300777 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2cb30a39-796b-499d-9971-b8981247eaab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:29.301602 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2cb30a39-796b-499d-9971-b8981247eaab admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:29.302040 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2cb30a39-796b-499d-9971-b8981247eaab admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:29.336440 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-2cb30a39-796b-499d-9971-b8981247eaab admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198890 Jul 27 15:26:29.337005 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jul 27 15:26:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:26:30.160426 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:30.161427 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Jul 27 15:26:30.161812 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:26:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:30.357626 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-0e8204ec-0932-4811-8ce2-fcb9ec99a2ec admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:30.360045 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:30.360045 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 27 15:26:30.361234 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-0e8204ec-0932-4811-8ce2-fcb9ec99a2ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:30.361680 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-0e8204ec-0932-4811-8ce2-fcb9ec99a2ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:30.362462 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-0e8204ec-0932-4811-8ce2-fcb9ec99a2ec admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:30.362892 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-0e8204ec-0932-4811-8ce2-fcb9ec99a2ec admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:30.382452 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-0e8204ec-0932-4811-8ce2-fcb9ec99a2ec admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082157 Jul 27 15:26:30.383017 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jul 27 15:26:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:26:41.619972 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:41.620970 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 27 15:26:41.621353 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:41.763249 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell0:SELECT=4 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:41.763986 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell1:SELECT=4 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:41.764581 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=8 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:41.813288 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-482bc719-6ceb-4681-b797-11b319150452 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:41.815624 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:41.815624 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 27 15:26:41.816929 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-482bc719-6ceb-4681-b797-11b319150452 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:41.817369 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-482bc719-6ceb-4681-b797-11b319150452 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:41.818140 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-482bc719-6ceb-4681-b797-11b319150452 admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:41.818563 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-482bc719-6ceb-4681-b797-11b319150452 admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:41.843370 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-482bc719-6ceb-4681-b797-11b319150452 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084420 Jul 27 15:26:41.843867 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jul 27 15:26:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:42.662589 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:42.663594 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-c0fe934b-7ca8-4165-8e24-3383d6d40a7a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 27 15:26:42.664024 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jul 27 15:26:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:42.852855 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-aa2d050b-1d31-49e4-ab37-5e98e7406e8b admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:42.855215 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:42.855215 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 27 15:26:42.856426 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-aa2d050b-1d31-49e4-ab37-5e98e7406e8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:42.856870 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-aa2d050b-1d31-49e4-ab37-5e98e7406e8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:42.857652 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-aa2d050b-1d31-49e4-ab37-5e98e7406e8b admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:26:42.858107 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-aa2d050b-1d31-49e4-ab37-5e98e7406e8b admin admin] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:26:42.880705 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-aa2d050b-1d31-49e4-ab37-5e98e7406e8b admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079734 Jul 27 15:26:42.881187 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jul 27 15:26:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:27:40.269475 dv-cinder-841315-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 15:27:40.270331 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: Wed Jul 27 15:27:40 2022 - graceful shutdown triggered... Jul 27 15:27:40.270808 dv-cinder-841315-2-iscsi devstack@n-api.service[103187]: Gracefully killing worker 1 (pid: 103187)... Jul 27 15:27:40.271172 dv-cinder-841315-2-iscsi devstack@n-api.service[103188]: Gracefully killing worker 2 (pid: 103188)... Jul 27 15:27:41.271557 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: worker 1 buried after 1 seconds Jul 27 15:27:41.271557 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: worker 2 buried after 1 seconds Jul 27 15:27:41.271557 dv-cinder-841315-2-iscsi devstack@n-api.service[103186]: goodbye to uWSGI. Jul 27 15:27:41.273093 dv-cinder-841315-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 15:27:41.273641 dv-cinder-841315-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 15:27:41.276729 dv-cinder-841315-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 15:27:41.286918 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 15:27:41.289593 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 15:27:41 2022] *** Jul 27 15:27:41.289790 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 15:27:41.290071 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 15:27:41.290237 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: nodename: dv-cinder-841315-2-iscsi Jul 27 15:27:41.290377 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: machine: x86_64 Jul 27 15:27:41.290528 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: clock source: unix Jul 27 15:27:41.290670 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: pcre jit disabled Jul 27 15:27:41.290814 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: detected number of CPU cores: 4 Jul 27 15:27:41.290955 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: current working directory: / Jul 27 15:27:41.291096 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: detected binary path: /usr/bin/uwsgi-core Jul 27 15:27:41.291260 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: your processes number limit is 47680 Jul 27 15:27:41.291405 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: your memory page size is 4096 bytes Jul 27 15:27:41.291557 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: detected max file descriptor number: 2048 Jul 27 15:27:41.291701 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: lock engine: pthread robust mutexes Jul 27 15:27:41.292029 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: thunder lock: enabled Jul 27 15:27:41.292388 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 15:27:41.292635 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 15:27:41.334078 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: Python main interpreter initialized at 0x560df5e899c0 Jul 27 15:27:41.334078 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: python threads support enabled Jul 27 15:27:41.334078 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: your server socket listen backlog is limited to 100 connections Jul 27 15:27:41.334078 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: your mercy for graceful operations on workers is 90 seconds Jul 27 15:27:41.334532 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 15:27:41.334532 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: *** Operational MODE: preforking *** Jul 27 15:27:41.334785 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: *** uWSGI is running in multiple interpreter mode *** Jul 27 15:27:41.334785 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: spawned uWSGI master process (pid: 117855) Jul 27 15:27:41.334992 dv-cinder-841315-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 15:27:41.335564 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: spawned uWSGI worker 1 (pid: 117869, cores: 1) Jul 27 15:27:41.336167 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: spawned uWSGI worker 2 (pid: 117870, cores: 1) Jul 27 15:27:41.336514 dv-cinder-841315-2-iscsi devstack@n-api.service[117855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 15:27:41.995785 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 15:27:42.001031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 15:27:43.166284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:27:43.166284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: from cryptography.utils import int_from_bytes Jul 27 15:27:43.167008 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:27:43.167008 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: from cryptography.utils import int_from_bytes Jul 27 15:27:43.167268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:27:43.167268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: from cryptography.utils import int_from_bytes Jul 27 15:27:43.168303 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:27:43.168303 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: from cryptography.utils import int_from_bytes Jul 27 15:27:45.606025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:27:45.606663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:27:45.606978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:27:45.607164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:27:45.607415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:27:45.607801 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.608149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.608470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.608787 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.609116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.609423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.609746 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.610061 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.610386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.610642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.610953 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.611272 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-2-iscsi {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.611589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.612069 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.612384 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.612703 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.613011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.613334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.613640 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.614144 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.619901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.620561 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.620643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:27:45.621022 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:27:45.621183 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-2-iscsi {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621183 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621320 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:27:45.621390 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621458 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:27:45.621543 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:27:45.621691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621768 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621846 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.621944 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622103 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622172 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622571 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622651 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.622983 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623300 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-2-iscsi {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623687 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.623770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.625610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.625793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.625944 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.626099 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.626250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.626402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.626544 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.626684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.626841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627164 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627321 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627321 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627604 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627771 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.627972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.628132 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.628284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.628435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.628593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.628742 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.628886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.629036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.629183 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.629331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.629482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.629623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.630252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.630426 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.630581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.630729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.630878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.631037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.631194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.631343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.631343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.633732 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-2-iscsi {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.633911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634084 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634538 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634824 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.634975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.635130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.635270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.635420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.635569 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.635720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.635947 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636097 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636538 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.636992 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.637139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.637289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.637437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.637591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.637732 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.637878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638172 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638321 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638620 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638771 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.638927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639068 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639370 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639519 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639666 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639814 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.639979 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.640133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.640274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.640415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.640554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.640693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.640848 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.641003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.641154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.641294 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.641443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.641591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.641766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.642459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.642613 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.642764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.642906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.643178 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.643341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.643491 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.643640 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.643968 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.644120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.644268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.644417 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.644574 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.644714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.644861 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.645009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.645167 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.645413 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.645560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.645709 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.645859 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646008 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646585 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.646871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.647040 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.647753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.647940 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.648100 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.648250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.648391 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.648530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.648678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.648827 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.649565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.649728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.649881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650343 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650641 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.650922 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.651069 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.651209 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.651358 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.651499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.651649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.651790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.652005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.652005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.653026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.653179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.653327 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.653327 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.653713 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.653888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654277 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654424 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654424 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654848 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.654989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.655149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.655299 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.655447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.655595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.655749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.655910 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656556 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656697 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656835 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.656981 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.657137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.657282 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.657430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.657578 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.657718 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.657864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.658011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.658151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.658304 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.658446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.658591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.658738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.658878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.659034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.659187 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.659331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.659469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.659616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.659755 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.660067 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.660228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.660372 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.660520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.660661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.660808 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.660958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.661107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.661246 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.661396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.661537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.661684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.661831 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.661971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.662110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.662281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.662898 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.663043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.663185 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.663334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.663476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.663646 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.663929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.664091 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.664341 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.664499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.664651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.664799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.664949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.665090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.665237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.665377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.665537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.665687 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.665829 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.665829 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.666101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.666249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.666406 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.666548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.666697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.666837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.666977 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.667131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.667295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.667445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.667593 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.667734 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.667892 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.668053 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.668196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.668344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.668495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.668649 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.668799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.668940 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.669079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.669246 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:27:45.669389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.669530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.669669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.669817 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.669967 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.670196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.670351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.670493 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.670633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.670780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.670935 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.671244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.671396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.671537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.671683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.671876 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.672041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.672041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.672317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.673083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.673247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.673400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.673549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.673691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.673868 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.674107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.674253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.674508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.674666 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.674816 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.674958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.675410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.675570 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.675726 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.675885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676491 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.676922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.677064 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.677204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.677355 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.677588 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.677732 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.677879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678168 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678627 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678767 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.678913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.679060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.679060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.679346 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.679485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.679632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.679779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.680537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.680700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.680861 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681282 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681588 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.681870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.682017 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.682158 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.682311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.682461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.682713 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.683245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.683402 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.683554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.683711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.683914 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.684062 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.684321 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.684487 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.684719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.684875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685164 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685324 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685467 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685467 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685750 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.685890 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686038 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686178 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686317 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686466 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686757 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.686914 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.687162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.687341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.687509 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.687661 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.687802 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.687964 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.688117 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.688267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.688417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.688566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.688707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.688854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.689115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.689276 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.689442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.689591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.689733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.689881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690333 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690785 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.690890 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691297 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691674 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691815 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.691987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.692116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.692243 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.692377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.692505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.692642 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.692852 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.693352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.693499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.693637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.693776 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.693906 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.694040 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.694177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.694328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.694547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.695035 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.695165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.695298 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.695431 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.695649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.696298 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.696442 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.696615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.696763 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.696892 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697019 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697146 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697676 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697804 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.697943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698081 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698216 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698469 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.698905 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699297 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699565 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699704 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699847 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.699976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700360 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700360 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700360 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700360 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700830 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700966 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.700966 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701350 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701350 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701731 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701731 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.701978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.702973 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.703330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.703330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.703725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.703915 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704057 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704447 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.704930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.705072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.705072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.705420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706129 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706129 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706396 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706526 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706526 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.706911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.707228 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.707357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.707357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.707692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.707822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.707822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708219 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708219 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708597 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708597 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.708960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709627 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709899 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.709899 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710155 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710673 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710926 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.710926 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711204 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.711904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.712292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.712422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.712422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.712660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.712794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.712794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.713137 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.713467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.713736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.713877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.713877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.716584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.716733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.716733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.717901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.718929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719058 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719679 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719806 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.719806 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720234 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720370 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720507 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.720914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721052 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721317 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.721992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722122 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722122 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722368 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722885 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.722885 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.723139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.723567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.723567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.723995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724777 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.724904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725297 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725297 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725672 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725672 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.725950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.726093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.726224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.726529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.726529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.726529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.726927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727053 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727317 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727455 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727592 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727592 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.727876 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728277 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.728803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729060 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729203 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.729871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730135 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730135 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730395 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730832 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.730961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.731217 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.731345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.731345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.731604 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.731732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.731732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732016 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.732802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.733064 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.733199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.733199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.733707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.733864 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.733864 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.734266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.734401 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.734401 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.734648 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.734778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.734914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735187 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735698 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735698 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.735959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.736085 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.736085 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.736349 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.736498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.736498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.736924 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737059 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737187 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737394 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737394 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737657 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737792 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.737792 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738315 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738697 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.738832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.739036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.739176 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.739335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.739598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.739729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.739945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.740111 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.740290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.740551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.740690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.741541 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.741682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.741812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.741947 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.742086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.742086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.742857 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.742999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.742999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.743261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.743917 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744768 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744898 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.744898 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.745138 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.745266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.745266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.745597 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.745832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.745832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.746079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.746214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.746377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.746665 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.746988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.746988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.747238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.747364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.747589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.747725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.747906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.748188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.748352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.748506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.748660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.748813 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.749052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.749184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.749418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.749556 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.749727 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.750011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.750143 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.750329 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.750502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.750632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.750926 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.751063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.751238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.751534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.751674 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.751876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.752127 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.752266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.752479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.752624 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.752786 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.753038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.753177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.753383 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.753520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.753688 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.754413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.754792 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.754928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.755919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.756659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.756659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.756922 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.757233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.757457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.757598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.757738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.757738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.758050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.758687 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.758817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.758955 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759479 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759759 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.759929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760967 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.760967 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.761207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.761344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.761481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.761617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.761754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.761883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762298 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762689 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762832 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.762832 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763075 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763339 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763475 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763613 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.763928 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.764356 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.764628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.764762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.764901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765304 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765559 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765831 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.765958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766502 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766773 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.766910 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.767038 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.767195 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.767512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.767652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.767781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.767945 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768624 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.768878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769018 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769148 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.769952 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770208 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770617 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770786 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.770920 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.771095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.771234 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.771417 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.771551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.771719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.771952 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.772098 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.772271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.772413 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.772583 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.772723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.772892 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773347 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773524 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.773989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.774397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.774687 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.774833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.774964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.775812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776710 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.776974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.777103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.777238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.777238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.777669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.777669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.777936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778718 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.778949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.779086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.779223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.779363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.779494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.780313 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.780462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.780605 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.780759 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.780911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781347 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781487 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781636 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.781930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782080 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782504 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782662 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.782963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.783250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.783400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.783543 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.783703 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.783885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.784046 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.784199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.784625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.784930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785089 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785231 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785512 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785666 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785809 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.785949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.786089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.786237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.786378 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.786528 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.786670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.786811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.787097 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.787261 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.787415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.787582 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.787915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.788079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.788231 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.788374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.788525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.788674 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.788831 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.789256 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.789435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.789435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.789730 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.789874 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790024 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.790917 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.791065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.791214 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.791375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.791518 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.791660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.791800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792627 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792768 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.792909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793618 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.793908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.794064 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.794207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.794354 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.794781 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.795065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.795231 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.795375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.795524 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.795685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.795845 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796163 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.796906 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.797060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.797210 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.797353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.797510 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.797654 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798208 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798360 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798502 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798642 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.798988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.799150 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.799293 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.799441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.799601 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.799758 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.799946 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800109 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800543 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800694 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800844 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.800986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.801133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.801274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.801425 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.801582 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.801726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.801867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802016 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802452 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802745 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.802887 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803029 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803759 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.803926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.804083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.804234 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.804382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.804524 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.805566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.805727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.805883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.806037 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.806177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.806317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.806317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.806593 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.806766 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.807508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.807628 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.807722 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.807810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.807945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808032 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808106 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808559 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808718 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808881 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.808961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809342 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809573 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809724 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.809948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810026 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810105 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810497 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.810988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.811089 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.811303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.811399 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.811612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.811706 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.811943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.812053 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.812278 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.812373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.812585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.812686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.812911 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813013 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813228 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813319 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.813977 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.814157 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.814249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.814460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.814560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.814769 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.814867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.815079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.815179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.815379 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.815479 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.815685 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.815802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816129 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816641 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.816945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.817107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.817244 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.817441 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.817550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.817754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.817846 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.818092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.818184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.818423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.818532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.818726 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.818818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.819034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.819148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.819338 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.819440 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.819920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.820024 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.820226 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.820329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.821086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.821190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.821404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.821503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.821714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.821808 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822023 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822647 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.822954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.823054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.823263 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.823363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.823662 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.823753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824314 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.824931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.825060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.825239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.825342 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.825545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.825790 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.825892 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.826124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.826218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.826441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.826542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.826772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.826868 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.827099 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.827193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.827405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.827506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.827713 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.827806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828137 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828366 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828679 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828773 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.828988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.829091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.829294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.829396 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.829604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.829698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.829911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830218 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830319 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830524 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.830932 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.831139 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.831233 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.831446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.831545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.831759 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.832115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.832225 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.832422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.832514 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.832728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.832828 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833040 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833773 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.833996 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.834144 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.834311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.834402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.834622 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.834712 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.834933 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835069 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835243 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835338 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835649 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.835983 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.836223 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.836316 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.836553 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.836656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.836864 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.836964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.837166 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.837258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.837496 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.837596 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.837838 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.837966 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.838847 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.838960 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839132 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839422 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839502 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839574 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.839938 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840026 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840758 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.840979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.841083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.841297 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.841394 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.841610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.841708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.841919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.842024 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.842225 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.842322 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.842529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.842625 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.842839 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843168 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843310 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843606 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.843940 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.844114 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.844270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.844419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.844635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.844793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.844937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.845200 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.845531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.845682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.845840 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.846203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.846355 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.846497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.846645 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.846795 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.846937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.847096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.847239 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.847405 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.847566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.847708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.847881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848334 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.848772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.849156 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.849409 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.849557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.849719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.849870 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850012 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850161 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850302 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850596 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850747 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.850889 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.851038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.851181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.851181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.851474 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.851625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.852340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.852520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.852662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.852802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.852957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.853100 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.853242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.853391 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.853542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.853691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.853849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854146 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854428 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.854864 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.855011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.855180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.855607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.855770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.855965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.856258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.856419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.856569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.856711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.856930 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857224 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857515 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857807 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.857949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858096 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858688 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858830 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.858978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.859118 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.859363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.859621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.859769 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.859942 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860085 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860398 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860848 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.860999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.861141 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.861281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.861431 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.861573 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.861714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.861855 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862312 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862604 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.862894 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863474 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.863951 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864046 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864286 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864647 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.864914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.865014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.865014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:27:45.865185 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.865525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.865865 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.866188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.866525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.866864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.867176 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.868108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.868426 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.868758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.869075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.869395 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.869712 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.870075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.870348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.870663 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.870978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.871292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.871610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.871953 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.872271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.872586 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.872907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.873223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.873546 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.873895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.874222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.874546 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.874865 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.875188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.875510 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.875836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.876161 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.876476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.876798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.877134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.877453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.877763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.878193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.878515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.878840 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.879164 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.879480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.879809 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.880162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.880478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.880804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.881121 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.881458 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.881801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.882138 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.882470 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.882783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.883159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.883470 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.883785 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.884133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.884463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.884758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.885068 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.885383 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.885690 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.885997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.886306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.886614 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.886926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.887232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.887538 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.887858 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.888171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.888480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.888788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.889100 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.889406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.889715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.890021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.890328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.890634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.890973 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.891312 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.891630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.891981 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.892300 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.892627 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.892948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.893275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.893603 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.893923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.894239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.894576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.894891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.895210 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.895535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.895849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.896171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.896485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.896819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.897151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.897464 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.897793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.898113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.898437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.898784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.899102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.899438 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.899757 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.900109 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.900424 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.900740 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.901055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.901375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.901691 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.902007 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.902328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.902647 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.902985 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.903319 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.903633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.903988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.904322 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.904673 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.904988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.905336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.905671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.905986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.906301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.906611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:27:45.906856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:27:45.926055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO dbcounter [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Registered counter for database nova_api Jul 27 15:27:45.946699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:45.953516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writer thread running {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:45.969291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Registered counter for database nova_api Jul 27 15:27:45.989751 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:45.997000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.008755 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.context [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad4132ff-22fa-42e9-8152-725bc0f0dfda(cell1) {{(pid=117869) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:27:46.012854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:27:46.014415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:27:46.015200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:27:46.017308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:27:46.019274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO dbcounter [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Registered counter for database nova_cell0 Jul 27 15:27:46.023230 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO dbcounter [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Registered counter for database nova_cell1 Jul 27 15:27:46.030328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:46.032468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:46.037969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writer thread running {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.039948 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writer thread running {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.052636 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.context [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad4132ff-22fa-42e9-8152-725bc0f0dfda(cell1) {{(pid=117870) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:27:46.057451 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:27:46.059025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:27:46.059852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:27:46.062692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:27:46.064878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Registered counter for database nova_cell0 Jul 27 15:27:46.069074 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Registered counter for database nova_cell1 Jul 27 15:27:46.077311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:46.079229 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:46.085102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.087174 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.187529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO dbcounter [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Registered counter for database nova_cell0 Jul 27 15:27:46.194058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:46.201115 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writer thread running {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.236354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Registered counter for database nova_cell0 Jul 27 15:27:46.243878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:27:46.248180 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:27:46.516510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: WARNING keystonemiddleware.auth_token [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:27:46.524308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: WARNING keystonemiddleware.auth_token [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:27:46.564913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:27:46.572988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:27:46.867364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: WARNING keystonemiddleware.auth_token [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:27:46.873393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: WARNING keystonemiddleware.auth_token [None req-bce2c29e-89f4-436e-bb4f-afbbd686a5e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:27:46.878693 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560df5e899c0 pid: 117869 (default app) Jul 27 15:27:46.923721 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:27:46.929736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-01e99ce0-05c6-4a5b-9262-5354ea17b280 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:27:46.935608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560df5e899c0 pid: 117870 (default app) Jul 27 15:28:27.479440 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.487160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.487160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.487160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.709337 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.710958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.712391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:27.713387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:28.778321 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-534b56ac-a432-419d-af0d-f93a0857de0d tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Action: 'create', calling method: .version_select at 0x7f9fe1b51d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-434071013", "metadata": {"Type": "work"}}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:29.098612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e40f2352-4739-4deb-80d0-7572eb00ef77 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Action: 'create', calling method: .version_select at 0x7f9fe1b50ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-636692672"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:30.756909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e40f2352-4739-4deb-80d0-7572eb00ef77 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.056564 Jul 27 15:28:30.757710 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jul 27 15:28:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3060 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 15:28:30.779636 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-14cd7713-5953-4932-a397-f61606a481f0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19bbaf0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:31.341359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-14cd7713-5953-4932-a397-f61606a481f0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 200 len: 344 microversion: 2.1 time: 0.573325 Jul 27 15:28:31.341921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:30 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 344 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:31.760213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-534b56ac-a432-419d-af0d-f93a0857de0d tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.295412 Jul 27 15:28:31.772767 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Jul 27 15:28:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4310 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 15:28:31.780175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2d655b4-7f89-478b-ac13-d41e69d980e7 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19cf280>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:31.861842 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a2d655b4-7f89-478b-ac13-d41e69d980e7 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 200 len: 352 microversion: 2.1 time: 0.088278 Jul 27 15:28:31.863198 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:31 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:32.357587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c92e4a3f-f647-407f-8cde-54a65212b829 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19b9b80>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:32.496204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c92e4a3f-f647-407f-8cde-54a65212b829 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 200 len: 345 microversion: 2.1 time: 0.143131 Jul 27 15:28:32.496204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 2/5] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:32 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:32.520436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9de24a81-fd86-43d9-97b9-82a6a12045b4 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Action: 'create', calling method: .version_select at 0x7f9fe19cf940>, body: {"snapshot": {"volume_id": "c7ca9213-b7f1-42c1-8f0a-818de793d01b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1633304466"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:32.880171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8595ca07-aa68-4249-9f7a-3679bd16c0f4 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19ce310>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.080411 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9de24a81-fd86-43d9-97b9-82a6a12045b4 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.574205 Jul 27 15:28:33.129997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 4/6] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Jul 27 15:28:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:33.129997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c71b8dc6-9672-41a5-a1fc-1c4a46581481 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19cfca0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.208288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8595ca07-aa68-4249-9f7a-3679bd16c0f4 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 200 len: 353 microversion: 2.1 time: 0.333443 Jul 27 15:28:33.209239 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:32 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 353 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:33.221385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-212d9089-2dcc-45d7-9496-905e814bc12d tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19ce9d0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.262476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c71b8dc6-9672-41a5-a1fc-1c4a46581481 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 200 len: 287 microversion: 2.1 time: 0.173016 Jul 27 15:28:33.263031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:33 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:33.275462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4b718595-ccec-42cc-9343-50a8c6212dde tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19cf4c0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.374239 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-212d9089-2dcc-45d7-9496-905e814bc12d tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 200 len: 353 microversion: 2.1 time: 0.156584 Jul 27 15:28:33.375291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:33 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:33.400180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5311b8a9-e848-4987-819a-2b2ef396d8b9 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19b9d30>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.455359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4b718595-ccec-42cc-9343-50a8c6212dde tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.184690 Jul 27 15:28:33.455941 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 6/10] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Jul 27 15:28:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:33.468184 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c7f09f45-d253-46ae-ac46-292c2eacebea tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19d7550>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.661049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5311b8a9-e848-4987-819a-2b2ef396d8b9 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 202 len: 0 microversion: 2.1 time: 0.271873 Jul 27 15:28:33.661613 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:28:33 2022] DELETE /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:33.670446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f7595cb5-60f6-47e3-b67b-0f2f7b80a7dc tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19ceb80>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.800026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c7f09f45-d253-46ae-ac46-292c2eacebea tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 200 len: 287 microversion: 2.1 time: 0.336201 Jul 27 15:28:33.804897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:33 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 287 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:33.908068 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f7595cb5-60f6-47e3-b67b-0f2f7b80a7dc tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 200 len: 352 microversion: 2.1 time: 0.241750 Jul 27 15:28:33.909162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:33 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:34.814715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f32a7b4b-c315-4344-a5f4-e6f7592130bf tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19bbc10>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:34.906371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f32a7b4b-c315-4344-a5f4-e6f7592130bf tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 200 len: 287 microversion: 2.1 time: 0.097568 Jul 27 15:28:34.907423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 8/14] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:34 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:34.923162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9f088458-eaf9-4f87-9f79-64f7e66653c1 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19ce3a0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:35.054203 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9f088458-eaf9-4f87-9f79-64f7e66653c1 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 200 len: 352 microversion: 2.1 time: 0.135653 Jul 27 15:28:35.054973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 7/15] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:34 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:35.919096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-79adda78-a07d-4656-8d2c-f2efc0fbdaed tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19cf430>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:35.971102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-79adda78-a07d-4656-8d2c-f2efc0fbdaed tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 200 len: 287 microversion: 2.1 time: 0.056378 Jul 27 15:28:35.971909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:35 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:36.069719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-03f5d656-7e86-4685-8323-0148e74916f6 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19b9d30>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:36.215361 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-03f5d656-7e86-4685-8323-0148e74916f6 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 200 len: 352 microversion: 2.1 time: 0.150394 Jul 27 15:28:36.216007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:36 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:36.292941 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1874741422", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:36.484257 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] validate_networks() for [('54d4d7af-884d-4461-b1ad-55fbebbc888a', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:28:36.983996 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c6750beb-5824-469e-99a8-998bdbcfcdf8 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19ce1f0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:37.033338 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c6750beb-5824-469e-99a8-998bdbcfcdf8 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 200 len: 288 microversion: 2.1 time: 0.053328 Jul 27 15:28:37.033915 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:36 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 288 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:37.049672 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5e7acd55-ba6b-4f60-8936-0573ea12ca69 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19ceb80>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:37.204004 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5e7acd55-ba6b-4f60-8936-0573ea12ca69 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 202 len: 0 microversion: 2.1 time: 0.162355 Jul 27 15:28:37.206179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1254 bytes} [Wed Jul 27 15:28:37 2022] DELETE /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:37.216628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2dc4a164-cd21-4d92-a322-71387a40faf2 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19ced30>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:37.275170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2dc4a164-cd21-4d92-a322-71387a40faf2 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 200 len: 287 microversion: 2.1 time: 0.065231 Jul 27 15:28:37.276369 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:37 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:37.284586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d6fb44f5-3dfc-43e5-ad1a-5811b942d0f3 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Calling method '.version_select at 0x7f9fe19ce550>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:37.354470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-d6fb44f5-3dfc-43e5-ad1a-5811b942d0f3 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] HTTP exception thrown: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d6fb44f5-3dfc-43e5-ad1a-5811b942d0f3 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Request method failure captured: Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d HTTP/1.1 Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmbVDTLU9ye0v_2aMu9rUrAHZIGzs3FIwRV0tWTB00ajWkpTMuwuJ_mfiCTkp6EMoLNUSWfPOMssk7N8kffE2FJHiET3WwAv30NBt5ZIu5QqFT31513Yy9ADcjeQY4dGcx5TQYDBjhFQC4FfLZ9WPnO2iQmKywZ_XWUZ3zfS5bvk58 Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: cfd56d6b673a4a74943ba094ae3f6cda Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesGetTestJSON-1788586431 Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:37.359149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cfd56d6b673a4a74943ba094ae3f6cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cfd56d6b673a4a74943ba094ae3f6cda", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cfd56d6b673a4a74943ba094ae3f6cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cfd56d6b673a4a74943ba094ae3f6cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesGetTestJSON-1788586431 Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: cfd56d6b673a4a74943ba094ae3f6cda Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesGetTestJSON-1788586431 Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesGetTestJSON-1788586431-project Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: ac794ca0ac284d2bb417a07239f34e55 Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesGetTestJSON-1788586431-project Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'b12150be-c560-4de9-8000-66a9eec4773d'} Jul 27 15:28:37.360326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. (HTTP 404) (Request-ID: req-50982fed-1162-4e53-a78e-11f59bc73356) Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:37.360974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:37.361856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 15:28:37.362882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. Jul 27 15:28:37.364826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:37.367610 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d6fb44f5-3dfc-43e5-ad1a-5811b942d0f3 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] Returning 404 to user: Volume b12150be-c560-4de9-8000-66a9eec4773d could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:37.368713 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d6fb44f5-3dfc-43e5-ad1a-5811b942d0f3 tempest-VolumesGetTestJSON-1788586431 tempest-VolumesGetTestJSON-1788586431-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d" status: 404 len: 109 microversion: 2.1 time: 0.091134 Jul 27 15:28:37.369482 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 12/21] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:37 2022] GET /compute/v2.1/os-volumes/b12150be-c560-4de9-8000-66a9eec4773d => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:38.291456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-36ab8462-be7d-4e24-bba3-41c5d5a8fcf0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe1936430>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:38.342385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-36ab8462-be7d-4e24-bba3-41c5d5a8fcf0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] HTTP exception thrown: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-36ab8462-be7d-4e24-bba3-41c5d5a8fcf0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Request method failure captured: Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b HTTP/1.1 Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmbFZcBWqKQ--vUnv6A4BDjLkoJEGYR3lCgRGKV9HL0PZnD8S2vOkIwzNGu7S0AervbaG4XZTvMJuPQWaHM7Nr62N7oRsSmoIpM9mHn-udlfE7oyjPM8nXcbgjwRx0o7-EpaiPJurtev9d-G31vaXEzRXzDBb77QsXlyp0XVvhl8OI Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:38.345233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85b0f788133b43dba1ddcb9be9d9c6f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 571667712bee4f87a22fff9490151b5a Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'c0fc9f57-e8af-4961-8ead-69f74ac3ad3b'} Jul 27 15:28:38.346505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. (HTTP 404) (Request-ID: req-4ef6bf0b-3b15-4cd3-a7e4-40b2dc5d2aac) Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.347204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:38.348400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 15:28:38.349437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. Jul 27 15:28:38.352227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:38.354328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-36ab8462-be7d-4e24-bba3-41c5d5a8fcf0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Returning 404 to user: Snapshot c0fc9f57-e8af-4961-8ead-69f74ac3ad3b could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:38.355717 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-36ab8462-be7d-4e24-bba3-41c5d5a8fcf0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b" status: 404 len: 111 microversion: 2.1 time: 0.071589 Jul 27 15:28:38.359856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 13/22] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:28:38 2022] GET /compute/v2.1/os-snapshots/c0fc9f57-e8af-4961-8ead-69f74ac3ad3b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:28:38.371550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ab83ccd1-1e7d-469a-bc2f-9254397a34e2 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe1c13ca0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:38.515946 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ab83ccd1-1e7d-469a-bc2f-9254397a34e2 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 202 len: 0 microversion: 2.1 time: 0.154684 Jul 27 15:28:38.516584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 14/23] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:28:38 2022] DELETE /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:38.526055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c5d99844-59ac-4ab5-bb49-5c524518eee8 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19363a0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:38.611023 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:28:38.611705 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:28:38.612282 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:28:38.612821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:28:38.613933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:28:38.625042 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c5d99844-59ac-4ab5-bb49-5c524518eee8 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 200 len: 344 microversion: 2.1 time: 0.103968 Jul 27 15:28:38.625801 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 15/24] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:38 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:38.646707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:38.648574 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:38.649482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:38.649974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:38.715876 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:28:38.760176 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for user 51657a0e4865469999bdf8cd5102dad1 and project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:28:38.831515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:28:38.846847 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:28:39.054625 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-021c3b4f-60fe-451b-953a-2a61408bf302 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.977693 Jul 27 15:28:39.062351 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 10/25] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:28:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:28:39.067141 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-135971b2-50be-410b-b03e-38efe2fc4163 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:39.067989 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-135971b2-50be-410b-b03e-38efe2fc4163 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:39.358551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-135971b2-50be-410b-b03e-38efe2fc4163 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:39.394409 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-135971b2-50be-410b-b03e-38efe2fc4163 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1222 microversion: 2.1 time: 0.330959 Jul 27 15:28:39.398153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 16/26] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:39 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:28:39.640139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b3c7bfe5-35b1-47d4-ac1d-d7e6cc82a4ed tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe18da820>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:39.731184 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b3c7bfe5-35b1-47d4-ac1d-d7e6cc82a4ed tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 200 len: 344 microversion: 2.1 time: 0.095690 Jul 27 15:28:39.732041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 11/27] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:39 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:39.811775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-336787858", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:40.067031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] validate_networks() for [('54d4d7af-884d-4461-b1ad-55fbebbc888a', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:28:40.745831 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e05f6e78-4bc3-498c-82ff-267da7f59418 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe18dae50>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:40.903963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e05f6e78-4bc3-498c-82ff-267da7f59418 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 200 len: 344 microversion: 2.1 time: 0.161806 Jul 27 15:28:40.910367 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 12/28] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:40 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:41.923292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-10b102bc-1cc3-4c86-84ea-7d392bd764c0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe18dad30>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:42.057620 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-10b102bc-1cc3-4c86-84ea-7d392bd764c0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] HTTP exception thrown: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-10b102bc-1cc3-4c86-84ea-7d392bd764c0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Request method failure captured: Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b HTTP/1.1 Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmbFZcBWqKQ--vUnv6A4BDjLkoJEGYR3lCgRGKV9HL0PZnD8S2vOkIwzNGu7S0AervbaG4XZTvMJuPQWaHM7Nr62N7oRsSmoIpM9mHn-udlfE7oyjPM8nXcbgjwRx0o7-EpaiPJurtev9d-G31vaXEzRXzDBb77QsXlyp0XVvhl8OI Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:28:42.061754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85b0f788133b43dba1ddcb9be9d9c6f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 571667712bee4f87a22fff9490151b5a Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'c7ca9213-b7f1-42c1-8f0a-818de793d01b'} Jul 27 15:28:42.062909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. (HTTP 404) (Request-ID: req-193cf456-2742-45eb-a660-aa3bbe709d77) Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.063532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:42.064580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 15:28:42.066415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-10b102bc-1cc3-4c86-84ea-7d392bd764c0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Returning 404 to user: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:42.067526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-10b102bc-1cc3-4c86-84ea-7d392bd764c0 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 404 len: 109 microversion: 2.1 time: 0.149296 Jul 27 15:28:42.073501 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:41 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:42.105356 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a86ee839-9fcb-4ac0-b972-1203505b092b tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe19d7d30>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:42.246620 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-a86ee839-9fcb-4ac0-b972-1203505b092b tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] HTTP exception thrown: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a86ee839-9fcb-4ac0-b972-1203505b092b tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Request method failure captured: Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b HTTP/1.1 Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmbFZcBWqKQ--vUnv6A4BDjLkoJEGYR3lCgRGKV9HL0PZnD8S2vOkIwzNGu7S0AervbaG4XZTvMJuPQWaHM7Nr62N7oRsSmoIpM9mHn-udlfE7oyjPM8nXcbgjwRx0o7-EpaiPJurtev9d-G31vaXEzRXzDBb77QsXlyp0XVvhl8OI Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:28:42.249096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85b0f788133b43dba1ddcb9be9d9c6f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 571667712bee4f87a22fff9490151b5a Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'c7ca9213-b7f1-42c1-8f0a-818de793d01b'} Jul 27 15:28:42.250207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. (HTTP 404) (Request-ID: req-7cb27157-8f08-407c-9fd7-d6dc61531eb6) Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.250808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 15:28:42.251704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 15:28:42.253419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a86ee839-9fcb-4ac0-b972-1203505b092b tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Returning 404 to user: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a86ee839-9fcb-4ac0-b972-1203505b092b tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 404 len: 109 microversion: 2.1 time: 0.167636 Jul 27 15:28:42.254269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 14/30] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:28:42 2022] DELETE /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:28:42.264036 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-931d5f44-ef14-4b97-8ae9-c7499060c1a1 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Calling method '.version_select at 0x7f9fe0851160>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:42.366787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-931d5f44-ef14-4b97-8ae9-c7499060c1a1 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] HTTP exception thrown: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-931d5f44-ef14-4b97-8ae9-c7499060c1a1 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Request method failure captured: Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b HTTP/1.1 Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmbFZcBWqKQ--vUnv6A4BDjLkoJEGYR3lCgRGKV9HL0PZnD8S2vOkIwzNGu7S0AervbaG4XZTvMJuPQWaHM7Nr62N7oRsSmoIpM9mHn-udlfE7oyjPM8nXcbgjwRx0o7-EpaiPJurtev9d-G31vaXEzRXzDBb77QsXlyp0XVvhl8OI Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:28:42.369754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85b0f788133b43dba1ddcb9be9d9c6f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85b0f788133b43dba1ddcb9be9d9c6f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 85b0f788133b43dba1ddcb9be9d9c6f7 Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847672648 Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 571667712bee4f87a22fff9490151b5a Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847672648-project Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'c7ca9213-b7f1-42c1-8f0a-818de793d01b'} Jul 27 15:28:42.370979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. (HTTP 404) (Request-ID: req-a515a875-35f2-49f1-b901-1589824856fd) Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.371667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:42.372682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 15:28:42.373659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-931d5f44-ef14-4b97-8ae9-c7499060c1a1 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] Returning 404 to user: Volume c7ca9213-b7f1-42c1-8f0a-818de793d01b could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:42.374646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-931d5f44-ef14-4b97-8ae9-c7499060c1a1 tempest-VolumesSnapshotsTestJSON-847672648 tempest-VolumesSnapshotsTestJSON-847672648-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b" status: 404 len: 109 microversion: 2.1 time: 0.116057 Jul 27 15:28:42.375897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 15/31] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:42 2022] GET /compute/v2.1/os-volumes/c7ca9213-b7f1-42c1-8f0a-818de793d01b => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:43.505248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:28:43.507430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:28:43.507957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:28:43.508388 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:28:43.509045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:28:43.565675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:43.566235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:43.572489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:43.572976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:43.749357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:28:43.790853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for user 51657a0e4865469999bdf8cd5102dad1 and project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:28:43.845690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:28:43.859492 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:28:44.146223 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-86598b41-6b80-42f5-a409-868ae1d4f424 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.335673 Jul 27 15:28:44.148540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 17/32] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:28:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 4342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:28:44.167492 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f67e7acd-ec25-4606-94d0-919d35801935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:44.170171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f67e7acd-ec25-4606-94d0-919d35801935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:44.420625 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f2b6ec8b-6b55-44e0-a672-f891f4107dbf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: .version_select at 0x7f9fe18da940>, body: {"keypair": {"name": "tempest-keypair-925597554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIejhomqQ9Tj8D6/IxWb3Kc1bVSW0B8IeofYMx3mObiHgaPTlZ9n1ulGdppKattjZ8rCXcEZVFypVMW6lSEwlTFuCoq8YNhPRFZKRMq2dwwTo1jhHWSF9guqfQz5h0qQCg=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:44.440973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f67e7acd-ec25-4606-94d0-919d35801935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:44.465252 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f67e7acd-ec25-4606-94d0-919d35801935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1221 microversion: 2.1 time: 0.303158 Jul 27 15:28:44.466145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 18/33] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:44 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1221 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:44.511756 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-f2b6ec8b-6b55-44e0-a672-f891f4107dbf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for project fddbf2261d1f42d0a41aa921197fc181. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:28:44.549667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-f2b6ec8b-6b55-44e0-a672-f891f4107dbf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for user a2b027a2c8dd4459b1309faab28f3d4b and project fddbf2261d1f42d0a41aa921197fc181. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:28:44.702509 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f2b6ec8b-6b55-44e0-a672-f891f4107dbf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.990677 Jul 27 15:28:44.705401 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 16/34] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:28:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:45.491310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-280e2ba8-2ab1-443f-90c7-175a8fe64949 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:45.492086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-280e2ba8-2ab1-443f-90c7-175a8fe64949 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:46.518440 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-280e2ba8-2ab1-443f-90c7-175a8fe64949 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:46.540424 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-280e2ba8-2ab1-443f-90c7-175a8fe64949 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1221 microversion: 2.1 time: 1.053119 Jul 27 15:28:46.548017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:45 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1221 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:46.698547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-630621994", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "networks": [{"uuid": "d6880b01-7ed5-4f46-967a-222879a1ea88"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:46.851605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] validate_networks() for [('d6880b01-7ed5-4f46-967a-222879a1ea88', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:28:47.569372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:47.572485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:47.590323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:47.591612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:47.594644 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:47.597838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:48.187437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:48.242870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dac2516c-ba16-4bd9-a16b-8e77755b8de6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1273 microversion: 2.1 time: 0.680380 Jul 27 15:28:48.244800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:47 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1273 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:48.690461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:48.691270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:49.267565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:49.273503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:49.317362 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:49.323123 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:49.326435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:49.332453 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:49.692835 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:49.712741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cd3be42c-7807-4760-82d2-50e8fa0b4e83 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1279 microversion: 2.1 time: 0.449989 Jul 27 15:28:49.719405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 21/37] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:49 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1279 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:28:50.738399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:28:50.739463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:28:50.740147 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:28:50.740735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:28:50.741352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:28:50.766452 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:50.767063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:50.768104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:50.768683 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:50.835363 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Getting quotas for project e1c7c86e4b1c40ec8e4335a2770353f5. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:28:50.861392 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Getting quotas for user 1989ddc458d645af8d017987a6b93809 and project e1c7c86e4b1c40ec8e4335a2770353f5. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:28:50.898209 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:28:50.900326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:28:50.980001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8bd5e6dc-b835-4aaa-9dbc-8e43102432bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'create', calling method: .version_select at 0x7f9fe07a9940>, body: {"keypair": {"name": "tempest-keypair-1190150241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ikUbKTmgp3o5lduRY0YybioeLRUPUqFTu0Pllo1Nu7SpRMM5vkoF7+46sNsfTz/qXDMJzDpMX1VIqN8oKubkdfCon/RXhipMc3Qfh/cFlX70AmPmZuQej0zFqxaGzJQ=="}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:51.015095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-81d2ac1c-f715-43bb-b066-31de4881439b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.669327 Jul 27 15:28:51.016915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 17/38] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:28:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 4672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:28:51.024171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:51.025029 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:51.044145 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:51.044910 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:51.045875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:51.046700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:51.074495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-8bd5e6dc-b835-4aaa-9dbc-8e43102432bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:28:51.121347 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-8bd5e6dc-b835-4aaa-9dbc-8e43102432bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for user 7a964a003f8e4f1da603a13eb7f534ca and project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:28:51.250865 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8bd5e6dc-b835-4aaa-9dbc-8e43102432bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.528441 Jul 27 15:28:51.261660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 22/39] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Jul 27 15:28:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1533 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 15:28:51.289980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bd710417-5f24-4b8f-8236-5dca09154928 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:51.295034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bd710417-5f24-4b8f-8236-5dca09154928 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:51.499110 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-bd710417-5f24-4b8f-8236-5dca09154928 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:51.514979 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bd710417-5f24-4b8f-8236-5dca09154928 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1214 microversion: 2.1 time: 0.243984 Jul 27 15:28:51.514979 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 23/40] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:51 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:52.031487 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:52.071187 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dd2bbaf7-07d4-4cbd-a566-fe58187ab4d9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1279 microversion: 2.1 time: 1.052619 Jul 27 15:28:52.073280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 18/41] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:51 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1279 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:52.533995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:52.534775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:52.549003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:52.549561 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:52.550361 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:52.550812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:52.993195 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:53.010320 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-060de95c-3ffb-4ced-9a2f-7cba80cf55d9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1218 microversion: 2.1 time: 0.480273 Jul 27 15:28:53.025092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 24/42] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:52 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1218 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:53.100758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.102979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:53.123961 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:53.125636 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:53.129463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:53.130306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:53.653708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:53.703328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a8bd77ab-0f83-4a49-9c25-3b5b00690d34 tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Action: 'create', calling method: .version_select at 0x7f9fe073f700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-619375410", "metadata": {"Type": "work"}}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a8bd77ab-0f83-4a49-9c25-3b5b00690d34 tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Request method failure captured: Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 121 Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vm1tyeylaJZE2Rnbx2r4uBpTdTySmGOdYdaob-HCgkta_h3xN0Vio0Hto_cHeNOZNUOikE3RGJneyG5evKOOMXcVFv8suNmgtXWHNJGAKVgk0kL5pXopTQIL1DHKGQufKzMrQbhq6Jw2Jvvv_3DKCruppjy8DiNWHDr_Wnq-pD2lzo Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:53.712942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d87aff68ffd043c28325263d420856dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d87aff68ffd043c28325263d420856dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 67617ddbde374dca87405daae7952920 Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-619375410", "metadata": {"Type": "work"}}} Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:53.714316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-619375410', 'metadata': {'Type': 'work'}}}} Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise error Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:53.715120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 15:28:53.717279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 15:28:53.718628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 15:28:53.718628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.727460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a8bd77ab-0f83-4a49-9c25-3b5b00690d34 tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:53.729494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a8bd77ab-0f83-4a49-9c25-3b5b00690d34 tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.385576 Jul 27 15:28:53.732760 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 25/43] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Jul 27 15:28:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:28:53.746232 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4120a197-075c-4e08-828b-4aa97bacb99c tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Action: 'create', calling method: .version_select at 0x7f9fe0752f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1048194707", "metadata": {"Type": "work"}}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4120a197-075c-4e08-828b-4aa97bacb99c tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Request method failure captured: Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 120 Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vm1tyeylaJZE2Rnbx2r4uBpTdTySmGOdYdaob-HCgkta_h3xN0Vio0Hto_cHeNOZNUOikE3RGJneyG5evKOOMXcVFv8suNmgtXWHNJGAKVgk0kL5pXopTQIL1DHKGQufKzMrQbhq6Jw2Jvvv_3DKCruppjy8DiNWHDr_Wnq-pD2lzo Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:53.764586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d87aff68ffd043c28325263d420856dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d87aff68ffd043c28325263d420856dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 67617ddbde374dca87405daae7952920 Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1048194707", "metadata": {"Type": "work"}}} Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:53.765947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1048194707', 'metadata': {'Type': 'work'}}}} Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise error Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi '0' Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:53.766748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 15:28:53.768025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 15:28:53.769170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 15:28:53.769170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.774416 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4120a197-075c-4e08-828b-4aa97bacb99c tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:53.778522 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4120a197-075c-4e08-828b-4aa97bacb99c tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039472 Jul 27 15:28:53.781600 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 26/44] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Jul 27 15:28:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:28:53.805917 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c19248de-24d0-4894-b103-1de7c2a6e47f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Action: 'create', calling method: .version_select at 0x7f9fe07a9c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-51054826", "metadata": {"Type": "work"}}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c19248de-24d0-4894-b103-1de7c2a6e47f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Request method failure captured: Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 117 Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vm1tyeylaJZE2Rnbx2r4uBpTdTySmGOdYdaob-HCgkta_h3xN0Vio0Hto_cHeNOZNUOikE3RGJneyG5evKOOMXcVFv8suNmgtXWHNJGAKVgk0kL5pXopTQIL1DHKGQufKzMrQbhq6Jw2Jvvv_3DKCruppjy8DiNWHDr_Wnq-pD2lzo Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:53.819291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d87aff68ffd043c28325263d420856dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d87aff68ffd043c28325263d420856dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 67617ddbde374dca87405daae7952920 Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-51054826", "metadata": {"Type": "work"}}} Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:53.820676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-51054826', 'metadata': {'Type': 'work'}}}} Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise error Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi '' Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:53.821423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 15:28:53.822676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 15:28:53.823703 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 15:28:53.823703 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.828712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c19248de-24d0-4894-b103-1de7c2a6e47f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:53.835177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c19248de-24d0-4894-b103-1de7c2a6e47f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.046696 Jul 27 15:28:53.838199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 27/45] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Jul 27 15:28:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:28:53.857965 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-065e5b21-46b7-484b-8d10-e354ca4f736b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Calling method '.version_select at 0x7f9fe073f550>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.945672 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-065e5b21-46b7-484b-8d10-e354ca4f736b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] HTTP exception thrown: Volume tempest-invalid-1198148005 could not be found. Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-065e5b21-46b7-484b-8d10-e354ca4f736b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Request method failure captured: Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1198148005 HTTP/1.1 Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vm1tyeylaJZE2Rnbx2r4uBpTdTySmGOdYdaob-HCgkta_h3xN0Vio0Hto_cHeNOZNUOikE3RGJneyG5evKOOMXcVFv8suNmgtXWHNJGAKVgk0kL5pXopTQIL1DHKGQufKzMrQbhq6Jw2Jvvv_3DKCruppjy8DiNWHDr_Wnq-pD2lzo Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:53.971151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d87aff68ffd043c28325263d420856dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d87aff68ffd043c28325263d420856dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 67617ddbde374dca87405daae7952920 Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Volume tempest-invalid-1198148005 could not be found. Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'tempest-invalid-1198148005'} Jul 27 15:28:53.972404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1198148005 could not be found. (HTTP 404) (Request-ID: req-8c08399e-ace0-42ec-b013-b9a476676b5e) Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.973165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 15:28:53.974271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1198148005 could not be found. Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:53.975382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1198148005 could not be found. Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1198148005 could not be found. Jul 27 15:28:53.976486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:53.979404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-065e5b21-46b7-484b-8d10-e354ca4f736b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Returning 404 to user: Volume tempest-invalid-1198148005 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:53.980454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-065e5b21-46b7-484b-8d10-e354ca4f736b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1198148005" status: 404 len: 99 microversion: 2.1 time: 0.137269 Jul 27 15:28:53.981781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 28/46] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Jul 27 15:28:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1198148005 => generated 99 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 15:28:54.004388 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bca8895c-e6bb-4a27-96a6-4aa06a266376 tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014638 Jul 27 15:28:54.008924 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 29/47] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Jul 27 15:28:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 15:28:54.027175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e69cb2da-05b6-4bbc-8483-854a5b75e7b0 tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014387 Jul 27 15:28:54.038576 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 30/48] 10.222.0.36 () {58 vars in 1137 bytes} [Wed Jul 27 15:28:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 15:28:54.064255 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:54.066267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:54.091890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:54.094634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:54.095741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:54.100360 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:55.074998 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:55.088393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bd0e6cdb-29b4-4f3c-8bcd-4ac988d74157 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1284 microversion: 2.1 time: 1.047570 Jul 27 15:28:55.090281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 31/49] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:54 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1284 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:55.104794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ce0576-63e3-4e20-8b28-acc9a7531e3f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Calling method '.version_select at 0x7f9fe0708c10>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:55.172371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:55.185684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-96ce0576-63e3-4e20-8b28-acc9a7531e3f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] HTTP exception thrown: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ce0576-63e3-4e20-8b28-acc9a7531e3f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Request method failure captured: Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/os-volumes/7eb797af-f8d3-42dd-addd-679eda32157b HTTP/1.1 Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vm1tyeylaJZE2Rnbx2r4uBpTdTySmGOdYdaob-HCgkta_h3xN0Vio0Hto_cHeNOZNUOikE3RGJneyG5evKOOMXcVFv8suNmgtXWHNJGAKVgk0kL5pXopTQIL1DHKGQufKzMrQbhq6Jw2Jvvv_3DKCruppjy8DiNWHDr_Wnq-pD2lzo Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:55.188469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d87aff68ffd043c28325263d420856dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d87aff68ffd043c28325263d420856dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 67617ddbde374dca87405daae7952920 Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '7eb797af-f8d3-42dd-addd-679eda32157b'} Jul 27 15:28:55.190154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. (HTTP 404) (Request-ID: req-07e00068-c152-4be4-bb25-5af7749b69a2) Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:55.191094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 15:28:55.192231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 15:28:55.193198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ce0576-63e3-4e20-8b28-acc9a7531e3f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Returning 404 to user: Volume 7eb797af-f8d3-42dd-addd-679eda32157b could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-96ce0576-63e3-4e20-8b28-acc9a7531e3f tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/7eb797af-f8d3-42dd-addd-679eda32157b" status: 404 len: 109 microversion: 2.1 time: 0.097430 Jul 27 15:28:55.194710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 32/50] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:28:55 2022] DELETE /compute/v2.1/os-volumes/7eb797af-f8d3-42dd-addd-679eda32157b => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:55.199916 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-600c568a-ebe1-40b5-a375-d5dd0257b3ac tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 2.102973 Jul 27 15:28:55.200310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3bb97199-76c4-4d89-8d42-5a3da98da05b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Calling method '.version_select at 0x7f9fe073f550>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:55.204991 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 19/51] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:53 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:55.298774 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-3bb97199-76c4-4d89-8d42-5a3da98da05b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] HTTP exception thrown: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3bb97199-76c4-4d89-8d42-5a3da98da05b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Request method failure captured: Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/os-volumes/4928fbdd-e77e-4bb2-9e41-3a5356f97a5e HTTP/1.1 Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vm1tyeylaJZE2Rnbx2r4uBpTdTySmGOdYdaob-HCgkta_h3xN0Vio0Hto_cHeNOZNUOikE3RGJneyG5evKOOMXcVFv8suNmgtXWHNJGAKVgk0kL5pXopTQIL1DHKGQufKzMrQbhq6Jw2Jvvv_3DKCruppjy8DiNWHDr_Wnq-pD2lzo Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:28:55.303494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d87aff68ffd043c28325263d420856dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d87aff68ffd043c28325263d420856dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d87aff68ffd043c28325263d420856dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d87aff68ffd043c28325263d420856dd Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesNegativeTest-1345539447 Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 67617ddbde374dca87405daae7952920 Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesNegativeTest-1345539447-project Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '4928fbdd-e77e-4bb2-9e41-3a5356f97a5e'} Jul 27 15:28:55.304817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. (HTTP 404) (Request-ID: req-4ad98c0d-e7ee-4ff4-bf76-ac73eb1e1187) Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:55.305626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 15:28:55.306797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 15:28:55.307976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. Jul 27 15:28:55.309138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:28:55.313092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3bb97199-76c4-4d89-8d42-5a3da98da05b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] Returning 404 to user: Volume 4928fbdd-e77e-4bb2-9e41-3a5356f97a5e could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:28:55.316407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3bb97199-76c4-4d89-8d42-5a3da98da05b tempest-VolumesNegativeTest-1345539447 tempest-VolumesNegativeTest-1345539447-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4928fbdd-e77e-4bb2-9e41-3a5356f97a5e" status: 404 len: 109 microversion: 2.1 time: 0.118062 Jul 27 15:28:55.330353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 33/52] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:28:55 2022] GET /compute/v2.1/os-volumes/4928fbdd-e77e-4bb2-9e41-3a5356f97a5e => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:56.118195 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:56.118912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:56.138310 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:56.138811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:56.147936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:56.148402 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:56.241905 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:56.243772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:56.269866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:56.270387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:56.276235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:56.284171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:56.784731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:56.795076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d2f1da67-04da-40ec-a359-57de5f253a52 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1272 microversion: 2.1 time: 0.685538 Jul 27 15:28:56.803241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 20/53] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:56 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1272 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:28:56.810194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1996092156", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c38721ce-4da8-41f0-9615-4459de2daf25"}], "security_groups": [{"name": "tempest-securitygroup--1601914141"}], "key_name": "tempest-keypair-925597554", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:57.935363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:57.952533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8951f25f-6a0a-4967-83e4-87a25e54dd22 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 1.725829 Jul 27 15:28:57.970947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 34/54] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:56 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:57.993557 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:57.996373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:58.013363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:58.014820 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:58.016814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:58.018629 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:58.402023 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:58.416293 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d035c9c6-f984-4c47-a448-097d044bff60 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1272 microversion: 2.1 time: 0.443455 Jul 27 15:28:58.420017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 35/55] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:57 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1272 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:58.453309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] validate_networks() for [('c38721ce-4da8-41f0-9615-4459de2daf25', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:28:58.907518 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-3a40f869-b5fa-41b4-a007-d1a6fc10aecf req-3772d8bf-9ce9-4a88-a6b8-96c9fbc4aa4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a82d27-5756-4ee1-8c2e-d6a26bf75f15", "tag": "3810c698-7926-46e1-9f80-aa481b319cbb"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:59.008444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-3a40f869-b5fa-41b4-a007-d1a6fc10aecf req-3772d8bf-9ce9-4a88-a6b8-96c9fbc4aa4d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:59.010875 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-3a40f869-b5fa-41b4-a007-d1a6fc10aecf req-3772d8bf-9ce9-4a88-a6b8-96c9fbc4aa4d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:59.093216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-3a40f869-b5fa-41b4-a007-d1a6fc10aecf req-3772d8bf-9ce9-4a88-a6b8-96c9fbc4aa4d service nova] Creating event network-changed:3810c698-7926-46e1-9f80-aa481b319cbb for instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 on hv-cinder-84131 Jul 27 15:28:59.098580 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-3a40f869-b5fa-41b4-a007-d1a6fc10aecf req-3772d8bf-9ce9-4a88-a6b8-96c9fbc4aa4d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 15:28:59.111552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:59.112945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:59.115412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:59.121331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:59.167249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.compute.rpcapi [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 15:28:59.171654 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] Releasing lock "compute-rpcapi-router" {{(pid=117869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 15:28:59.230323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-706257f9-6c1b-4e3d-ae79-a9ed6d8d7791 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.678515 Jul 27 15:28:59.232599 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 36/56] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:59.248000 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:59.258249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:28:59.282450 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:59.287511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:59.288880 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:28:59.291626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:28:59.826913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:00.307539 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:00.341681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-27af7e6e-0cfb-4929-999e-99bc4fa9e666 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 1.104480 Jul 27 15:29:00.348484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 37/57] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:28:59 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:00.365697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:00.373957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:00.397668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:00.398252 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:00.399616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:00.402204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:00.792798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:00.869787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=16 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:01.509690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=18 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:01.758931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:01.772577 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6607821b-3ff6-4c9b-a89d-949052eeef33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 1.419492 Jul 27 15:29:01.773942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 38/58] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:00 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:01.849916 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:29:01.850516 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:29:01.851135 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:29:01.851715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:29:01.852437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:29:01.867086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:01.870403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:01.871882 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:01.874290 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:01.939572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for project fddbf2261d1f42d0a41aa921197fc181. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:29:01.958195 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for user a2b027a2c8dd4459b1309faab28f3d4b and project fddbf2261d1f42d0a41aa921197fc181. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:29:01.995692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:29:02.002430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:29:02.157256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7668475c-ad6b-4c27-9dfc-663e6cb9e51a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.349041 Jul 27 15:29:02.158775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 21/59] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:28:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 5353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:29:02.164207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:02.184085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:02.215502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:02.217454 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:02.219212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:02.220277 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:02.374202 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-0ed78f1c-029d-410e-a1a1-ab75f57ade31 req-4a0b911a-65f6-4d56-9806-c8adbd27f32d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a75f912-669a-4719-b005-ed9bfc504f4f", "tag": "d43e69ee-e393-4930-9178-0cc2bbf003dd"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:02.404221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-0ed78f1c-029d-410e-a1a1-ab75f57ade31 req-4a0b911a-65f6-4d56-9806-c8adbd27f32d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:02.404736 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-0ed78f1c-029d-410e-a1a1-ab75f57ade31 req-4a0b911a-65f6-4d56-9806-c8adbd27f32d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:02.441674 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-0ed78f1c-029d-410e-a1a1-ab75f57ade31 req-4a0b911a-65f6-4d56-9806-c8adbd27f32d service nova] Creating event network-changed:d43e69ee-e393-4930-9178-0cc2bbf003dd for instance 9a75f912-669a-4719-b005-ed9bfc504f4f on hv-cinder-84131 Jul 27 15:29:02.450938 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-0ed78f1c-029d-410e-a1a1-ab75f57ade31 req-4a0b911a-65f6-4d56-9806-c8adbd27f32d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.675211 Jul 27 15:29:02.453498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 39/60] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:02.468381 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8ee083cd-5b3e-4f07-977e-27ade796315e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:02.469392 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8ee083cd-5b3e-4f07-977e-27ade796315e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:02.624407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8ee083cd-5b3e-4f07-977e-27ade796315e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:02.633300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8ee083cd-5b3e-4f07-977e-27ade796315e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1237 microversion: 2.1 time: 0.176700 Jul 27 15:29:02.636348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 40/61] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:02 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1237 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:02.643517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:02.674422 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e10b96c6-2962-4db0-a3e6-b8362ff09264 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.510942 Jul 27 15:29:02.677785 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1016287478", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bad7c82a-807d-4c47-8386-1a6c9fb4e649"}], "security_groups": [{"name": "tempest-securitygroup--867607015"}], "key_name": "tempest-keypair-1190150241", "user_data": "}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:02.678114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 22/62] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:02 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:02.795202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:02.795965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:02.815136 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:02.815755 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:02.824544 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:02.827061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:03.106448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] validate_networks() for [('bad7c82a-807d-4c47-8386-1a6c9fb4e649', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:29:03.181639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:03.198335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-024705e3-9181-4355-b130-a94af7f0ef04 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.406352 Jul 27 15:29:03.200174 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 23/63] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:02 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:03.661868 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:03.663093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:03.673502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:03.673963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:03.674744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:03.675192 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:03.850126 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:03.862313 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d25757a8-5f24-4297-b8f9-98238d5c50b1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1241 microversion: 2.1 time: 0.204393 Jul 27 15:29:03.865655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 24/64] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:03 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1241 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:03.888432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:03.891000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:03.907511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:03.914044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:03.914927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:03.915379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:03.961025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:29:03.962090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:29:03.962563 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:29:03.962981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:29:03.963400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:29:03.979398 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:03.979996 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:03.981036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:03.981482 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:04.001286 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:29:04.005691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for user 7a964a003f8e4f1da603a13eb7f534ca and project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:29:04.017676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:29:04.020209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:29:04.083443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4de1f3d4-4e85-4601-bb71-151de134b889 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.411465 Jul 27 15:29:04.085884 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 41/65] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Jul 27 15:29:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 15:29:04.096232 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dbe623f9-d917-4b38-8b43-a5cf6a5811d5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:04.097937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dbe623f9-d917-4b38-8b43-a5cf6a5811d5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:04.162879 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:04.174668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-22954dde-7715-431e-afc9-12218f7d795e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.307251 Jul 27 15:29:04.175560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 25/66] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:03 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:04.191445 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbe623f9-d917-4b38-8b43-a5cf6a5811d5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:04.213017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbe623f9-d917-4b38-8b43-a5cf6a5811d5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:04.220316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbe623f9-d917-4b38-8b43-a5cf6a5811d5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:04.221958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:04.222923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:04.224568 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dbe623f9-d917-4b38-8b43-a5cf6a5811d5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1282 microversion: 2.20 time: 0.131044 Jul 27 15:29:04.244620 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 42/67] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:04 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:04.248301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:04.253013 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:04.257509 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:04.260365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:04.590839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:04.600095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1741fbdf-beb0-4b30-838c-72439caa87f1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.383363 Jul 27 15:29:04.604453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 26/68] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:04 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:04.641467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-94dbf6df-8ea2-4c64-85b9-ff1afeae2031 req-e9265997-dbc9-43e7-a0d0-9b634451d011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4e3486-0439-4325-807e-433590eb231a", "tag": "a260e595-5546-4217-bc37-aa09f91168bd"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:04.673490 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-94dbf6df-8ea2-4c64-85b9-ff1afeae2031 req-e9265997-dbc9-43e7-a0d0-9b634451d011 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:04.674351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-94dbf6df-8ea2-4c64-85b9-ff1afeae2031 req-e9265997-dbc9-43e7-a0d0-9b634451d011 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:04.692946 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-94dbf6df-8ea2-4c64-85b9-ff1afeae2031 req-e9265997-dbc9-43e7-a0d0-9b634451d011 service nova] Creating event network-changed:a260e595-5546-4217-bc37-aa09f91168bd for instance 5d4e3486-0439-4325-807e-433590eb231a on hv-cinder-84131 Jul 27 15:29:04.700042 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-94dbf6df-8ea2-4c64-85b9-ff1afeae2031 req-e9265997-dbc9-43e7-a0d0-9b634451d011 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097003 Jul 27 15:29:04.701439 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 43/69] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:29:04.894613 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:04.895247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:04.902545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:04.903010 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:04.904075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:04.905072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.019180 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:05.027004 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2db35d87-3b68-462d-9f57-2b40daa87f4b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1241 microversion: 2.1 time: 0.136167 Jul 27 15:29:05.027588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 27/70] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:04 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:05.199418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:05.200166 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:05.206847 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:05.207293 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.208133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:05.208572 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.251110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:05.251729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:05.259543 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:05.260151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.261030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:05.261540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.324027 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:05.332142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:05.333737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:05.334839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fe47f13e-fcdd-4e98-8baa-e2b9e5a9b339 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1286 microversion: 2.20 time: 0.087797 Jul 27 15:29:05.335581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 28/71] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:05 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:05.354637 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:05.361949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5ca3df8d-7bdf-4933-ae3b-8cc5e46c46fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.166781 Jul 27 15:29:05.362685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 44/72] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:05 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:05.624033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:05.624589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:05.630427 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:05.630875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.631638 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:05.632110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:05.782530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:05.810315 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b150f0c3-f197-4c0d-9290-b810b314d1da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.174291 Jul 27 15:29:05.811476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 29/73] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:05 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:06.049152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:06.049779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:06.061979 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.064805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.065945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.069716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.206905 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.221352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ae4c4b64-b0b7-440e-b73a-01467cc24c0e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1241 microversion: 2.1 time: 0.176710 Jul 27 15:29:06.221962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 45/74] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:06 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1241 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:06.358444 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:06.359198 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:06.365608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.366277 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.366966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.367615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.383703 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:06.384671 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:06.391053 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.394160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.396795 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.401782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.456045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.469115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.477856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.479366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e419281a-b8de-4e9c-992d-aae4cfa80cd6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1278 microversion: 2.20 time: 0.124876 Jul 27 15:29:06.480400 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 30/75] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:06 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:06.645682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.661127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d77196e8-8bd8-497e-b996-ebc5708d1a76 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.277866 Jul 27 15:29:06.661958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 46/76] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:06 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:06.832337 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:06.833026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:06.839499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.840089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.840829 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:06.841258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:06.976270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.986198 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2e3c0c76-011e-417d-8534-5c84ef502ff9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.157955 Jul 27 15:29:06.987175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 31/77] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:06 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:07.244534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:07.245266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:07.248814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:07.254422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:07.255050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:07.255738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:07.256288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:07.329073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:07.336694 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f65caaa7-d18d-42f3-90bf-810916919525 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1241 microversion: 2.1 time: 0.096414 Jul 27 15:29:07.337438 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 47/78] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:07 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:07.505674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:07.506549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:07.528345 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:07.528780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:07.529764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:07.530205 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:07.609104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:07.616258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:07.617997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:07.619196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f3591144-bb54-4dcc-8c4b-3de52c9b3f1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1278 microversion: 2.20 time: 0.117646 Jul 27 15:29:07.627866 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 32/79] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:07 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:07.681949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:07.682568 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:07.688815 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:07.689264 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:07.690021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:07.690614 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:07.844077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:07.856068 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-45bde603-1d52-48b7-a1a7-adee852af785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.174384 Jul 27 15:29:07.856068 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 48/80] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:07 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:08.010598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:08.011420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:08.017409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.017854 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.018678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.019116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.150972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.158467 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-78e2a408-cfb7-42d4-9b09-8fd637d4c75c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.151616 Jul 27 15:29:08.159030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 33/81] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:08 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:08.357781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:08.358422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:08.365183 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.365634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.366419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.366852 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.369480 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=91 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:08.429959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.437471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1bd38037-4f23-451f-95a2-06773f5bc7de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1241 microversion: 2.1 time: 0.083461 Jul 27 15:29:08.438044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 49/82] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:08 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:08.644826 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:08.646232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:08.652721 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.653163 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.654068 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.654500 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.719150 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.722723 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:08.731295 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.733195 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.734536 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c29e96a-dff6-4418-896f-e8629e0f3223 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1278 microversion: 2.20 time: 0.094117 Jul 27 15:29:08.734965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 34/83] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:08 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:08.872371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:08.872931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:08.879779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.880856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:08.883111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:08.883558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:09.046224 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:09.054083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7bd47f6a-816e-4dde-8264-7d6ccc689fbb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.185697 Jul 27 15:29:09.054644 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 50/84] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:08 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:09.180671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:09.181461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:09.188391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:09.188839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:09.189610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:09.190307 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:09.331667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:09.339708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7b7b635b-10ce-4af7-93e0-ef969a86930f tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.165142 Jul 27 15:29:09.340303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 35/85] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:09 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:09.458737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:09.459352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:09.465909 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:09.466401 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:09.467653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:09.468143 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:09.533031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:09.539223 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f918b0a4-7a95-458e-926d-d7dacad1d9f5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1241 microversion: 2.1 time: 0.084853 Jul 27 15:29:09.539787 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 51/86] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:09 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:09.760883 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:09.762703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:09.771227 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:09.772375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:09.773964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:09.774619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.024015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:10.037262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:10.041853 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:10.044212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-afa53393-3823-4586-9943-27a636ae0141 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1278 microversion: 2.20 time: 0.289119 Jul 27 15:29:10.045463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 36/87] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:09 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:10.075108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:10.075636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:10.087509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.088003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.088978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.089580 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.382539 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:10.387655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-bdf93e3c-da3e-4ee2-acc5-e9038e17556f req-9a399007-ef90-43b6-85f7-6506c5f5a432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a82d27-5756-4ee1-8c2e-d6a26bf75f15", "name": "network-vif-plugged", "status": "completed", "tag": "3810c698-7926-46e1-9f80-aa481b319cbb"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:10.390043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-84884b6e-cc61-4dac-9d58-bb398db80852 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.318994 Jul 27 15:29:10.403099 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 52/88] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:10 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:10.403381 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-bdf93e3c-da3e-4ee2-acc5-e9038e17556f req-9a399007-ef90-43b6-85f7-6506c5f5a432 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.403381 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-bdf93e3c-da3e-4ee2-acc5-e9038e17556f req-9a399007-ef90-43b6-85f7-6506c5f5a432 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.407326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:10.408353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:10.415461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.415954 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.416734 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.417175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.424463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-bdf93e3c-da3e-4ee2-acc5-e9038e17556f req-9a399007-ef90-43b6-85f7-6506c5f5a432 service nova] Creating event network-vif-plugged:3810c698-7926-46e1-9f80-aa481b319cbb for instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 on hv-cinder-84131 Jul 27 15:29:10.425003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-bdf93e3c-da3e-4ee2-acc5-e9038e17556f req-9a399007-ef90-43b6-85f7-6506c5f5a432 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 15:29:10.426110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.427172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.427884 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.428319 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.436933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.compute.rpcapi [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 15:29:10.437819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] Releasing lock "compute-rpcapi-router" {{(pid=117870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 15:29:10.461908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-12b0bfd3-91c8-4328-9be7-9dd4712d8241 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136362 Jul 27 15:29:10.462787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 37/89] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:29:10.554848 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:10.565364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:10.565364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:10.565550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fb5e8894-9fd6-42ef-a056-ec5c4a496a79 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.170594 Jul 27 15:29:10.565550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 53/90] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:10 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:10.568114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.568569 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.569595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:10.570035 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:10.635195 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:10.642465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3844f12a-79d9-4882-ae4a-2142f9c19992 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1233 microversion: 2.1 time: 0.086627 Jul 27 15:29:10.643029 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 38/91] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:10 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:11.067001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:11.067623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:11.076043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.076610 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.077464 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.077904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.145009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:11.153462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:11.154976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:11.156106 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-05a9ee54-45b7-49ca-a7c4-6446e8abba60 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1334 microversion: 2.20 time: 0.093507 Jul 27 15:29:11.156663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 54/92] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:11 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:11.411502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:11.412155 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:11.418399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.418858 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.419708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.420099 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.550888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:11.558956 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-db959117-5e1f-4761-b7cc-322cd19c0016 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.151947 Jul 27 15:29:11.559525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 39/93] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:11 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:11.583476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:11.584137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:11.590325 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.590702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.591712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.592196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.664224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:11.664886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:11.671006 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.671448 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.672254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:11.672689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:11.737559 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:11.745061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3a7ad993-78a8-41fe-8f04-9f61197f67af tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1233 microversion: 2.1 time: 0.085294 Jul 27 15:29:11.745630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 40/94] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:11 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:11.781505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:11.790882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dc454ef4-99b6-4002-b652-afc5549859f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.211107 Jul 27 15:29:11.791517 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 55/95] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:11 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:12.179341 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:12.180002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:12.181895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:12.187361 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.187802 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.188572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.189002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.252314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:12.261223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:12.262799 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:12.263932 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8b7d5e06-201f-4afe-8a3c-582643a93e63 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1334 microversion: 2.20 time: 0.088443 Jul 27 15:29:12.264491 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 41/96] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:12 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:12.579955 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:12.580650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:12.586549 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.587107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.587740 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.588200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.746657 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:12.761934 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dc0b6f04-42eb-4146-a4fe-4f171072c88a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.184413 Jul 27 15:29:12.764054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 56/97] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:12 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:12.766261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:12.767031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:12.779931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.780399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.781322 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.789848 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.812005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:12.812850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:12.825492 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.826567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:12.829386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:12.833296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:13.381750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:13.393376 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3dfa80c6-b242-4207-92c8-36dbd515e415 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1289 microversion: 2.1 time: 0.629643 Jul 27 15:29:13.394833 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 42/98] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:12 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1289 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:13.408332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:13.409444 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:13.424215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:13.425003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:13.427515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:13.428533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:13.715456 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:13.728118 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:13.732419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:13.738987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7cf85306-9243-4ed0-b745-d8c1aa915426 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1340 microversion: 2.20 time: 0.338733 Jul 27 15:29:13.748302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 43/99] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:13 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1340 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:13.784821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:13.786005 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:13.799935 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:13.800790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:13.802105 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:13.806364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:13.989894 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=4 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:14.046770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:14.062650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-27485bdd-a1d0-432d-9dc9-d7c4a77b92a9 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 1.254593 Jul 27 15:29:14.064122 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 57/100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:12 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:14.166285 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:14.180249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-575305a6-ca0b-4456-a591-2106081dd969 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.399676 Jul 27 15:29:14.180987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 44/101] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:13 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:14.419604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:14.420240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:14.422221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=10 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:14.429730 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:14.430176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:14.430988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:14.431369 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:14.515524 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:14.523103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-31246bbd-f037-4edb-acad-70a00f06d92c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1295 microversion: 2.1 time: 0.107211 Jul 27 15:29:14.524471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 58/102] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:14 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:14.770963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:14.771698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:14.778331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:14.778873 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:14.779734 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:14.780296 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:14.860076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:14.870048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:14.872215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:14.873359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1fa8d89f-a927-403c-b11d-af1e2a08ffa2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1340 microversion: 2.20 time: 0.107084 Jul 27 15:29:14.873929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 45/103] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:14 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:15.084884 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:15.085500 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:15.091508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.092003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.092883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.093302 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.204512 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:15.205127 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:15.211901 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.212364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.213158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.213618 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.244691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:15.252523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dce9d809-f5f5-4df0-a86a-a696b2f2dac5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.171855 Jul 27 15:29:15.253516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 59/104] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:15 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:15.354914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:15.362194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fdcf37f0-eebe-4364-abee-bba23af38e49 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.161432 Jul 27 15:29:15.375617 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 46/105] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:15 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:15.548291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:15.549389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:15.564519 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.564519 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.564519 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.564519 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.634771 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:15.642581 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a82bf0e5-b237-457c-9f52-f7b8f6572441 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1295 microversion: 2.1 time: 0.100093 Jul 27 15:29:15.643236 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 60/106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:15 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:15.897731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:15.898359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:15.904408 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.904850 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.905603 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:15.906038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:15.971055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:15.979635 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:15.981193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:15.982283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-87e4ea3e-eade-4b28-89dc-25fbc0b2530e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1340 microversion: 2.20 time: 0.088556 Jul 27 15:29:15.982822 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 47/107] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:15 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:16.274978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:16.275581 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:16.281710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:16.282212 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:16.282994 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:16.283423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:16.382635 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:16.383253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:16.389475 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:16.389925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:16.390692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:16.391123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:16.420363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:16.428793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6824c8ca-7249-48b9-9cd3-df3e93205031 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.157772 Jul 27 15:29:16.429908 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 61/108] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:16 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:16.523514 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:16.532575 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c3f85e78-43e0-414d-bb3b-ea01933e68a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.153864 Jul 27 15:29:16.533150 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 48/109] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:16 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:16.662446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:16.663258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:16.669185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:16.669627 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:16.670374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:16.670804 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:16.736133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:16.744347 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-412e1ea0-34c9-49b2-89fe-683e6c56aca8 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1295 microversion: 2.1 time: 0.085520 Jul 27 15:29:16.744912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 62/110] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:16 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:17.007598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:17.008332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:17.019112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.020450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.021242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.021684 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.174994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:17.183745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-d371e92b-6a0a-4f90-8984-1543f9473ddd req-78252457-4785-48ed-affb-b95acfc918ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a75f912-669a-4719-b005-ed9bfc504f4f", "name": "network-vif-plugged", "status": "completed", "tag": "d43e69ee-e393-4930-9178-0cc2bbf003dd"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:17.186698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:17.189397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:17.195936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fc24efed-5829-4cd1-be89-c24971558f31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1340 microversion: 2.20 time: 0.194342 Jul 27 15:29:17.199511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-d371e92b-6a0a-4f90-8984-1543f9473ddd req-78252457-4785-48ed-affb-b95acfc918ae service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.199988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-d371e92b-6a0a-4f90-8984-1543f9473ddd req-78252457-4785-48ed-affb-b95acfc918ae service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.200447 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 49/111] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:17 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:17.222572 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-d371e92b-6a0a-4f90-8984-1543f9473ddd req-78252457-4785-48ed-affb-b95acfc918ae service nova] Creating event network-vif-plugged:d43e69ee-e393-4930-9178-0cc2bbf003dd for instance 9a75f912-669a-4719-b005-ed9bfc504f4f on hv-cinder-84131 Jul 27 15:29:17.228537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-d371e92b-6a0a-4f90-8984-1543f9473ddd req-78252457-4785-48ed-affb-b95acfc918ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048353 Jul 27 15:29:17.229677 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 63/112] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:29:17.449385 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:17.450088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:17.456382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.456945 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.457824 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.458490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.555754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:17.557131 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:17.568435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.569154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.572262 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.572708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.756154 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:17.766488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d58c197c-0cb7-4eca-9db2-8a76b9ac8202 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.321155 Jul 27 15:29:17.767669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 50/113] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:17 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:17.786872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:17.793125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:17.807313 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.808031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.828980 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:17.829424 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:17.989647 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:17.993452 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:18.001711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c13311f7-b108-454e-8aeb-612400c9704c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1295 microversion: 2.1 time: 0.219210 Jul 27 15:29:18.015867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 51/114] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:17 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1295 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:18.213889 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:18.222199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c585c61c-d32c-47cc-acd5-6ab9c029f1e3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.671180 Jul 27 15:29:18.222777 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 64/115] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:17 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:18.223767 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:18.224668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:18.231238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:18.232884 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:18.234123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:18.234763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:18.491481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:18.500123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:18.501621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:18.502727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2d8edd59-66a8-44b3-88fd-8a3a39f516a9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.283943 Jul 27 15:29:18.503581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 52/116] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:18 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:18.796314 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:18.796927 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:18.803427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:18.803904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:18.804664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:18.805096 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:18.930076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:18.937393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2dcf9fc9-e7fb-4505-88cb-c9773df1eeb4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.144905 Jul 27 15:29:18.937949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 65/117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:18 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:19.029586 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:19.030197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:19.036661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.037101 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.037854 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.038289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.168354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:19.175688 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7842fced-421a-49ff-808f-49da093f6a65 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.149861 Jul 27 15:29:19.176926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 53/118] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:19 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:19.242393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:19.243001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:19.248998 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.249442 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.250188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.250618 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.266441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=100 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:19.384681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:19.392031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5fcd9f4f-2fec-4343-83bf-bb8abeb1a935 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.153448 Jul 27 15:29:19.392598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 66/119] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:19 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:19.526155 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:19.526765 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:19.532877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.533334 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.534107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.534547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.659102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:19.666909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:19.668462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:19.669554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08b46026-5a8d-4b0b-ba04-859c2aaf36b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.147202 Jul 27 15:29:19.670116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 54/120] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:19 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:19.957987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:19.958592 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:19.964978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.965422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:19.966178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:19.966609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.090474 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:20.097920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bc14bc96-e729-4aca-89d9-96557f90784c tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.143645 Jul 27 15:29:20.098395 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 67/121] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:19 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:20.197849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:20.198398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:20.204577 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:20.205028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.205794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:20.206235 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.336215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:20.344771 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e5ac0479-1cb2-4a89-bfec-d163e5df3046 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.150746 Jul 27 15:29:20.345443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 55/122] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:20 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:20.413725 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:20.414391 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:20.420355 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:20.420811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.421579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:20.422018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.554452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:20.562313 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-628f768b-9f19-4d38-b547-aac4337a4f32 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.152934 Jul 27 15:29:20.563144 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 68/123] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:20 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:20.692402 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:20.693018 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:20.695072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:20.700350 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:20.700795 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.701578 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:20.702011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:20.827461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:20.835527 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:20.837270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:20.838362 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2f9e6184-0a5d-4342-9bce-c8f2f5c2f7ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.150500 Jul 27 15:29:20.838913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 56/124] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:20 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:21.118778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:21.119453 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:21.125444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.125894 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.126655 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.127090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.252923 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:21.260418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dbd702ca-49aa-44c7-a590-e6bf550389f6 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.145546 Jul 27 15:29:21.261011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 69/125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:21 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:21.366580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:21.367194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:21.373290 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.373744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.374515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.374943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.502533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:21.509930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e921825d-8b2e-4de1-8cfc-d2c9283e839b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.147654 Jul 27 15:29:21.510493 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 57/126] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:21 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:21.585049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:21.585707 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:21.591670 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.592153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.592914 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.593350 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.739554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:21.746939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-80e39c50-de6a-431c-9cdb-f192a3122544 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.166210 Jul 27 15:29:21.747505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 70/127] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:21 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:21.861655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:21.862544 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:21.868845 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.869292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:21.870051 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:21.870493 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.152366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:22.161202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:22.162830 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:22.164076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f25a10c6-4a45-474e-a736-791649e87e5d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.307406 Jul 27 15:29:22.164715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 58/128] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:21 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:22.283732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:22.285296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:22.295244 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:22.296484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.297412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:22.298046 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.502572 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:22.513933 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6c8bf52c-1195-43a1-8b11-9026197d1f05 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.236289 Jul 27 15:29:22.514784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 71/129] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:22 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:22.536138 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:22.536819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:22.542959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:22.543416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.544220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:22.544660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.767429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:22.769085 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:22.774354 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:22.774794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.778570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:22.778570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:22.831436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:22.840985 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cb7fc0cb-2a80-4bbf-ab56-accd0ed43c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.312030 Jul 27 15:29:22.842434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 59/130] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:22 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:22.925285 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:22.934043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-db7be5c6-1496-47b7-862f-8d1fc16f2741 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.170204 Jul 27 15:29:22.934814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 72/131] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:22 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:23.189905 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:23.190788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:23.202194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.202913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.210697 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.211172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.524378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-f2ef206c-e2e4-4e80-b703-51d176001b9d req-552fd20c-d7e5-45c3-aa65-78f87886f284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba023b6d-f35a-4213-979f-652a4c79acd9", "tag": "3f864415-ce7a-4cf3-afb1-cbde9b6bb602"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:23.555230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:23.562467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-f2ef206c-e2e4-4e80-b703-51d176001b9d req-552fd20c-d7e5-45c3-aa65-78f87886f284 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.563453 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-f2ef206c-e2e4-4e80-b703-51d176001b9d req-552fd20c-d7e5-45c3-aa65-78f87886f284 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.571449 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:23.572978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:23.574116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5a1e4cba-cb0e-4954-8b4b-cd6fd6ad4766 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.391408 Jul 27 15:29:23.579923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 60/132] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:23 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:23.591646 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-f2ef206c-e2e4-4e80-b703-51d176001b9d req-552fd20c-d7e5-45c3-aa65-78f87886f284 service nova] Creating event network-changed:3f864415-ce7a-4cf3-afb1-cbde9b6bb602 for instance ba023b6d-f35a-4213-979f-652a4c79acd9 on hv-cinder-84131 Jul 27 15:29:23.596068 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:23.599271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-f2ef206c-e2e4-4e80-b703-51d176001b9d req-552fd20c-d7e5-45c3-aa65-78f87886f284 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080205 Jul 27 15:29:23.600177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 73/133] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:23.614787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:23.636214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.637055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.642147 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.643281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.864320 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:23.865104 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:23.880574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.881231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.882040 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.882560 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.900943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:23.909633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d03764ca-0d02-479d-9b18-6fe40ea5db6d tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.328246 Jul 27 15:29:23.922741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 61/134] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:23 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:23.922741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-13f95166-69fb-4e6e-8ee8-130257b86bd8 req-82d9e4d2-7d2c-4868-b61b-c55de5b19bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4e3486-0439-4325-807e-433590eb231a", "name": "network-vif-plugged", "status": "completed", "tag": "a260e595-5546-4217-bc37-aa09f91168bd"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:23.929993 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-13f95166-69fb-4e6e-8ee8-130257b86bd8 req-82d9e4d2-7d2c-4868-b61b-c55de5b19bfc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.930498 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-13f95166-69fb-4e6e-8ee8-130257b86bd8 req-82d9e4d2-7d2c-4868-b61b-c55de5b19bfc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.961028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-13f95166-69fb-4e6e-8ee8-130257b86bd8 req-82d9e4d2-7d2c-4868-b61b-c55de5b19bfc service nova] Creating event network-vif-plugged:a260e595-5546-4217-bc37-aa09f91168bd for instance 5d4e3486-0439-4325-807e-433590eb231a on hv-cinder-84131 Jul 27 15:29:23.974000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-13f95166-69fb-4e6e-8ee8-130257b86bd8 req-82d9e4d2-7d2c-4868-b61b-c55de5b19bfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061953 Jul 27 15:29:23.976034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 62/135] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:23.981420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:23.982119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:23.989182 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.989631 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:23.990400 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:23.990878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:24.078112 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:24.087711 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-934dc764-5135-4580-b16e-52839911b48e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.228950 Jul 27 15:29:24.088528 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 74/136] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:23 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:24.136946 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:24.144718 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb25ead4-5358-4b74-a711-6ee326e50300 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.167500 Jul 27 15:29:24.145283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 63/137] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:23 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:24.598911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:24.599523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:24.605618 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:24.606067 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:24.606818 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:24.607248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:24.744999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:24.754428 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:24.756124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:24.757262 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-45d781ec-4ba8-4b1e-a42b-8f8f57efc414 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.163266 Jul 27 15:29:24.757790 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 75/138] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:24 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:24.930168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:24.930788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:24.932792 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:24.938057 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:24.938500 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:24.939287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:24.939716 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.071793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:25.079144 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08d80442-bd37-43b9-a06f-6009da49bc2e tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.152739 Jul 27 15:29:25.079721 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 64/139] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:24 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:25.109173 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:25.109856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:25.116574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.117022 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.117779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.118216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.165132 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:25.165763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:25.171615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.172090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.172843 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.173273 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.258465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:25.267255 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d7bb83b2-c57d-470b-b28e-f282257d19b4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.162056 Jul 27 15:29:25.274623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 76/140] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:25 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:25.319098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:25.329784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-249e6a88-79b1-48b2-8c5a-aeb6252e86af tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1321 microversion: 2.1 time: 0.168385 Jul 27 15:29:25.330628 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 65/141] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:25 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:25.630331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-d0e00792-9cd8-4488-823f-77dcaaae5a62 req-a9302535-8816-4789-abf6-c8af41d68e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:25.641248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-d0e00792-9cd8-4488-823f-77dcaaae5a62 req-a9302535-8816-4789-abf6-c8af41d68e88 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.642038 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-d0e00792-9cd8-4488-823f-77dcaaae5a62 req-a9302535-8816-4789-abf6-c8af41d68e88 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.655213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-d0e00792-9cd8-4488-823f-77dcaaae5a62 req-a9302535-8816-4789-abf6-c8af41d68e88 service nova] Creating event network-changed:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:29:25.661409 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-d0e00792-9cd8-4488-823f-77dcaaae5a62 req-a9302535-8816-4789-abf6-c8af41d68e88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037532 Jul 27 15:29:25.662055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 77/142] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:25.783039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:25.783421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:25.792616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.793077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.793930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:25.794336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:25.951720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:25.958044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:25.959529 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:25.960663 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e72a291c-d366-46e1-ab00-5dd30e33a908 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.182051 Jul 27 15:29:25.961221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 66/143] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:25 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:26.100924 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:26.101619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:26.107712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.108207 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.108982 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.109409 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.237520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:26.244939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-036642a6-a708-49db-b7cc-2bb303c8f992 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.148898 Jul 27 15:29:26.245494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 78/144] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:26 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:26.288551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:26.289159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:26.295141 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.295588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.296437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.296872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.350151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:26.350759 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:26.356909 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.357300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.358055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.358487 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.427292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:26.434662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d78ee80a-60b4-4522-91ba-1ee2e07f3981 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.150538 Jul 27 15:29:26.435334 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 67/145] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:26 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:26.489171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:26.496717 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3ceea230-b1cd-47f6-a8a2-e22ccd3dc75f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1515 microversion: 2.1 time: 0.150368 Jul 27 15:29:26.497290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 79/146] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:26 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:26.517978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:26.520907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:26.526797 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.527245 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.528043 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.528480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.590405 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lazy-loading 'flavor' on Instance uuid 9a75f912-669a-4719-b005-ed9bfc504f4f {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:29:26.641080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:26.707248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a96a37ab-853a-44e1-9b01-58cf31a1ef2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f/action" status: 200 len: 32 microversion: 2.1 time: 0.193300 Jul 27 15:29:26.707864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 68/147] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:29:26 2022] POST /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:29:26.716974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:26.717583 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:26.723483 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.723953 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.724696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.725125 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.852415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:26.861047 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dbc95905-8b02-4d43-b1a6-5450314f3955 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.147751 Jul 27 15:29:26.861770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 80/148] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:26 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:26.982929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:26.983628 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:26.990302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.990748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:26.991496 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:26.991966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:27.119724 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:27.127468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:27.129000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:27.130088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5af9e5e4-23ce-4e53-a472-1f79d6416e4a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.151390 Jul 27 15:29:27.130647 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 69/149] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:26 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:27.265157 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:27.265786 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:27.271963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:27.272403 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:27.273142 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:27.273569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:27.402486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:27.409752 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9081e9e4-978b-4feb-9b6b-8baed718809a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.148392 Jul 27 15:29:27.410838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 81/150] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:27 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:27.456254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:27.456869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:27.463275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:27.463728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:27.464506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:27.464936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:27.594335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:27.602339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c5d3128-69e7-4e2b-9098-aa74497c8790 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.149969 Jul 27 15:29:27.602911 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 70/151] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:27 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:27.882829 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:27.883457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:27.889468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:27.889906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:27.890660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:27.891085 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.031761 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:28.039242 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-77b15f77-d7d7-4235-b386-23c7adcbdae2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.160911 Jul 27 15:29:28.039809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 82/152] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:27 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:28.152303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:28.152909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:28.158756 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:28.159197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.159964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:28.160395 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.286396 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:28.294222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:28.295705 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:28.296822 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-782c938d-98ea-4f72-82c0-822f9cd638f3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.148409 Jul 27 15:29:28.297369 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 71/153] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:28 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:28.430949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:28.431565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:28.437531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:28.437982 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.438739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:28.439177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.566660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:28.574899 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3bdfd130-e583-4a49-a7d8-cdb1bf1aa528 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.147695 Jul 27 15:29:28.575468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 83/154] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:28 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:28.622802 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:28.623478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:28.630091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:28.630533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.631293 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:28.631783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:28.763902 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:28.772558 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d790fcdf-89be-40e3-a154-81fd464809a7 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.153827 Jul 27 15:29:28.773561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 72/155] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:28 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:29.060255 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:29.061036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:29.067681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.068162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.069222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.069671 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.086547 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=100 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:29.320630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:29.321635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:29.322466 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:29.332989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.333130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-13271262-08a6-48e8-a5da-4238aae973a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.275855 Jul 27 15:29:29.333839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.333974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 84/156] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:29 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:29.335671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.336695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.481261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:29.489160 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:29.490657 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:29.491749 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5105c200-c0d0-40f7-91a0-0efd535bf070 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.177060 Jul 27 15:29:29.492338 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 73/157] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:29 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:29.595567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:29.596106 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:29.602101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.602551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.604283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.604782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.797257 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:29.798575 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:29.809859 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.810557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.812745 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:29.813301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:29.841332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:29.860077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-41dfe900-63e6-4c4d-bd56-9af721c20298 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1314 microversion: 2.1 time: 0.262365 Jul 27 15:29:29.860710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 85/158] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:29 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:30.074366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:30.083281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-652bef1c-af4e-4c8e-b41f-1ef7c2a2533f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.293502 Jul 27 15:29:30.108258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 74/159] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:29 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:30.355766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:30.357300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:30.369894 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:30.371416 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:30.372741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:30.375482 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:30.514677 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:30.515286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:30.522534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:30.522985 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:30.523748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:30.524291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:30.542809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:30.553251 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7d5d53e9-40fe-41a1-a859-c454176f1f46 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.202318 Jul 27 15:29:30.553914 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 86/160] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:30 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:30.720307 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:30.728323 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:30.729821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:30.730931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-15cd27f7-cd44-4419-8f45-3f71faa46a56 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.220232 Jul 27 15:29:30.731488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 75/161] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:30 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:30.885511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:30.886175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:30.892455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:30.892904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:30.893669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:30.894102 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.063292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:31.078844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2e4cc2b9-97f8-46d1-870d-e2d2a8140fa1 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1502 microversion: 2.1 time: 0.197664 Jul 27 15:29:31.080624 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 87/162] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:30 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:31.105119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:31.105784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:31.112347 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:31.112797 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.114289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:31.114735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.292902 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:31.300602 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a3690cc1-9118-4dda-8fec-6762ab7ca96f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.199658 Jul 27 15:29:31.314718 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 76/163] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:31 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:31.576028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:31.576658 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:31.584209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:31.584660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.585873 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:31.586674 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.756374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:31.756965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:31.762812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:31.763266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.764048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:31.764510 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:31.790531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:31.800292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-00d0986b-9292-4bc0-a6a8-fa03e7389bfc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.228325 Jul 27 15:29:31.801500 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 88/164] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:31 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:31.904812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:31.912772 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:31.914272 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:31.915364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-467650d0-f099-4b07-8438-f3ab000e76d7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.163434 Jul 27 15:29:31.922961 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 77/165] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:31 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:32.323263 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:32.323903 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:32.330513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:32.330962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:32.331718 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:32.332211 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:32.465315 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:32.473264 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5df31adb-c127-40da-8f55-da537dd4ae98 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.153962 Jul 27 15:29:32.473936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 89/166] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:32 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:32.821022 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:32.821629 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:32.827742 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:32.828220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:32.829022 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:32.829450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:32.943142 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:32.944045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:32.956495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:32.957486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:32.958571 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:32.959169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:32.969693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:32.978155 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-94954ea4-a687-4fa5-a404-ca79f70aee1d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.161108 Jul 27 15:29:32.978959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 78/167] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:32 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:33.136396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:33.145289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:33.146788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:33.147908 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-960e8a91-d157-484d-8be1-71a8deee5525 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.208658 Jul 27 15:29:33.148463 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 90/168] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:32 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:33.493907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:33.494518 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:33.500561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:33.501011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:33.501766 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:33.502202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:33.644975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:33.652645 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cd339e9e-e77e-48e7-921b-05135b72c661 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.162464 Jul 27 15:29:33.653214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 79/169] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:33 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:33.999242 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:33.999870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:34.006119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:34.006564 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:34.007343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:34.007963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:34.145028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:34.152605 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b83d1685-e435-468d-ab4a-b327871ccd2c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.157254 Jul 27 15:29:34.153175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 91/170] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:33 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:34.170454 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:34.171995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:34.180065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:34.180512 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:34.181472 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:34.181902 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:34.335088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:34.343494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:34.345242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:34.346479 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d173bb2b-6e22-4bfb-9b92-d04a72958802 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.180073 Jul 27 15:29:34.347043 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 80/171] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:34 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:34.673037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:34.673649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:34.682931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:34.682931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:34.682931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:34.682931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:34.812677 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:34.820880 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e337256e-1e28-4713-93e0-bf27296635ee tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.151640 Jul 27 15:29:34.821446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 92/172] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:34 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:35.173778 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:35.174387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:35.180895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:35.181341 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:35.182123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:35.182566 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:35.307966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:35.315340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f6e5d99a-bf1a-4519-be03-4aae9e7bdd13 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.145380 Jul 27 15:29:35.315921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 81/173] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:35 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:35.373343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:35.373958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:35.379910 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:35.380366 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:35.381124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:35.381559 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:35.514772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:35.522651 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:35.524188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:35.525320 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-66adf2d7-7057-4f62-ad22-545b42d090b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.155913 Jul 27 15:29:35.525876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 93/174] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:35 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:35.843372 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:35.844027 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:35.850632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:35.851072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:35.851846 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:35.852314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:35.977814 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:35.985154 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b14f9479-4ca0-4329-82fa-3218e4be2d2e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.145554 Jul 27 15:29:35.985715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 82/175] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:35 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:36.337334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:36.337939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:36.344111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:36.344560 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:36.345312 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:36.345747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:36.473083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:36.480475 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9ca5f4d4-981e-40d6-a19d-56b3670b6348 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.146967 Jul 27 15:29:36.481042 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 94/176] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:36 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:36.548239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:36.548860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:36.555462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:36.555948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:36.556715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:36.557153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:36.686364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:36.689893 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:36.696125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:36.697595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:36.698680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f07f930b-fb48-4e48-b1db-24f2a9635e9a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.154687 Jul 27 15:29:36.699232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 83/177] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:36 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:37.005879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:37.006413 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:37.012377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.012825 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.013584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.014016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.144887 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:37.152626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0ad48285-90ff-4821-abc0-9eef48f83b22 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.150670 Jul 27 15:29:37.153192 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 95/178] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:37 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:37.514249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:37.514891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:37.528784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.529469 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.530439 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.531092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.722809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:37.723347 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:37.729465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=97 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:37.732989 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.733969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.735187 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.735874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.895408 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:37.907737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e847ed9d-7db7-45f1-9e15-c541ae8ff290 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.398701 Jul 27 15:29:37.922134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 84/179] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:37 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:37.922134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0bbffd6-ca97-4921-8e7c-890cbe0fc9f4"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:37.928517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:37.944754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.944909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:37.945837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:37.946364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:38.080856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:38.089978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:38.094886 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:38.097076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1ea3475d-4598-4a2e-beb2-8a97fedfbece tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.378518 Jul 27 15:29:38.104203 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 96/180] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:37 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:38.173631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:38.174248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:38.181429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:38.181877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:38.182641 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:38.183074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:38.362029 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:38.372098 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-21730c2b-8cee-4908-82ab-0bc745f91103 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.202356 Jul 27 15:29:38.373278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 97/181] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:38 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:38.486168 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-47ea15a7-a64d-403e-a132-45e357a0e034 req-9bf971b5-5648-45f5-9b54-f8765a763f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "name": "network-vif-plugged", "status": "completed", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:38.500376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-47ea15a7-a64d-403e-a132-45e357a0e034 req-9bf971b5-5648-45f5-9b54-f8765a763f84 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:38.500900 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-47ea15a7-a64d-403e-a132-45e357a0e034 req-9bf971b5-5648-45f5-9b54-f8765a763f84 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:38.515049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-47ea15a7-a64d-403e-a132-45e357a0e034 req-9bf971b5-5648-45f5-9b54-f8765a763f84 service nova] Creating event network-vif-plugged:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:29:38.520729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-47ea15a7-a64d-403e-a132-45e357a0e034 req-9bf971b5-5648-45f5-9b54-f8765a763f84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 Jul 27 15:29:38.521702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 98/182] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:29:38.930345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:38.931044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:38.937399 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:38.937850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:38.938607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:38.939135 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:39.073415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:39.081027 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-364f7153-e9a6-449c-a27a-d378bc2dd70d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.154940 Jul 27 15:29:39.081588 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 99/183] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:38 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:39.129946 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:39.131675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:39.143015 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:39.143857 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:39.144955 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:39.145554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:39.415725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8d2d8ede-fa94-4124-8638-160f453cc2b2 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "POST /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.498386 Jul 27 15:29:39.426112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 85/184] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:29:37 2022] POST /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a/os-volume_attachments => generated 194 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:39.429923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:39.431035 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:39.438531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:39.441290 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:39.442101 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:39.444560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:39.445260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:39.453043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:39.455862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:39.457803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8c3b778c-5cba-4b7a-b279-afe195036667 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.335934 Jul 27 15:29:39.471854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 100/185] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:39 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:39.626759 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:39.638939 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d6c11644-0cfe-4dbd-8269-a5f6186c395f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.216473 Jul 27 15:29:39.639746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 86/186] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:39 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:40.102521 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:40.103131 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:40.109996 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:40.110443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:40.111201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:40.111814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:40.457309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:40.462258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=100 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:40.470133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2337cefa-7ed1-46c4-93ee-b79ecfa41d1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.371092 Jul 27 15:29:40.470729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 101/187] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:40 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:40.486594 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:40.487215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:40.494348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:40.494823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:40.495737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:40.496222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:40.661349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:40.662222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:40.669975 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:40.670923 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:40.672268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:40.672819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:40.738480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:40.748081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:40.750711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:40.752240 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-66a305bb-c012-4396-844b-0af04b434194 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1407 microversion: 2.20 time: 0.273623 Jul 27 15:29:40.753291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 87/188] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:40 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:40.892492 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:40.903271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d7d95f6f-583f-44ec-ab4b-60089c249fe9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.245606 Jul 27 15:29:40.903860 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 102/189] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:40 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:41.495260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:41.496770 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:41.506665 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:41.507059 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:41.510450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:41.510901 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:41.716994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:41.730278 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c487f34-b0a0-4512-b307-021f4acda4f8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.239308 Jul 27 15:29:41.730950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 88/190] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:41 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:41.784688 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:41.785922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:41.795467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:41.795951 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:41.796725 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:41.797190 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:41.928287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:41.928905 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:41.935594 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:41.936068 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:41.937162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:41.937659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:41.967568 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:41.980728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:41.982528 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:41.983787 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-702f1bc3-ee44-4441-959b-ca1446edf1f4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1598 microversion: 2.20 time: 0.204156 Jul 27 15:29:41.984451 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 103/191] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:29:41 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1598 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:29:42.007801 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:42.008337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:42.014942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:42.015580 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:42.016368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:42.016947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:42.113760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:42.123040 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-219d9a80-fcfd-4d37-a940-edb9b65b8424 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.200992 Jul 27 15:29:42.128217 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 89/192] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:41 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:42.209625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5e6a2462-2a4b-4e08-a645-fdfaeee8d374 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.206360 Jul 27 15:29:42.210218 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 104/193] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Jul 27 15:29:42 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:29:42.588314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-51a605eb-6e4a-4485-92c9-8c4ea506f578 req-10b7528b-472d-45fb-aa49-a66e06287ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba023b6d-f35a-4213-979f-652a4c79acd9", "name": "network-vif-plugged", "status": "completed", "tag": "3f864415-ce7a-4cf3-afb1-cbde9b6bb602"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:42.606679 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-51a605eb-6e4a-4485-92c9-8c4ea506f578 req-10b7528b-472d-45fb-aa49-a66e06287ab2 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:42.607611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-51a605eb-6e4a-4485-92c9-8c4ea506f578 req-10b7528b-472d-45fb-aa49-a66e06287ab2 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:42.620576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-51a605eb-6e4a-4485-92c9-8c4ea506f578 req-10b7528b-472d-45fb-aa49-a66e06287ab2 service nova] Creating event network-vif-plugged:3f864415-ce7a-4cf3-afb1-cbde9b6bb602 for instance ba023b6d-f35a-4213-979f-652a4c79acd9 on hv-cinder-84131 Jul 27 15:29:42.626656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-51a605eb-6e4a-4485-92c9-8c4ea506f578 req-10b7528b-472d-45fb-aa49-a66e06287ab2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043703 Jul 27 15:29:42.627884 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 90/194] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:42.753287 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:42.754611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:42.764334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:42.768485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:42.769881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:42.770533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:43.147491 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:43.148280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:43.173044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:43.173252 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:43.174452 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:43.176079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:43.178508 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:43.189429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a2cdc0bd-1d42-4035-99f5-0a91e037826a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.440268 Jul 27 15:29:43.191772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 105/195] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:42 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:43.685151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:43.697978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-80640185-b18d-46e4-beab-96b6748e8c66 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.557481 Jul 27 15:29:43.703645 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 91/196] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:43 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:44.220315 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:44.221086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:44.231609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:44.232108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:44.232893 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:44.235161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:44.577590 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:44.604614 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9e5458dc-f2e6-4c22-86ee-e86d9b3a1a52 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.389650 Jul 27 15:29:44.605632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 106/197] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:44 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:44.623314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-9511fc6c-5f9d-4cdd-8fb6-9f4e2192311e req-a0b7038f-b3e8-4022-829b-354d9b2b77d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:44.646639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-9511fc6c-5f9d-4cdd-8fb6-9f4e2192311e req-a0b7038f-b3e8-4022-829b-354d9b2b77d6 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:44.647067 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-9511fc6c-5f9d-4cdd-8fb6-9f4e2192311e req-a0b7038f-b3e8-4022-829b-354d9b2b77d6 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:44.664511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-9511fc6c-5f9d-4cdd-8fb6-9f4e2192311e req-a0b7038f-b3e8-4022-829b-354d9b2b77d6 service nova] Creating event network-changed:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:29:44.674933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-9511fc6c-5f9d-4cdd-8fb6-9f4e2192311e req-a0b7038f-b3e8-4022-829b-354d9b2b77d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055308 Jul 27 15:29:44.676172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 92/198] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:44.733716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:44.734349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:44.758331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:44.758798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:44.765963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:44.766512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:45.285071 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:45.294278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-96610ce8-5b19-45a3-a26e-70a13d7d636d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1363 microversion: 2.1 time: 0.568386 Jul 27 15:29:45.294833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 107/199] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:44 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1363 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:45.630414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:45.640793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:45.667100 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:45.668274 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:45.671015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:45.673190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:46.023739 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:46.036620 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dadab1cf-b54f-4b40-a87b-c715928a5d72 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.412315 Jul 27 15:29:46.039944 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 93/200] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:45 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:46.317369 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:46.317983 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:46.334079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:46.335105 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:46.336082 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:46.336696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:46.976353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:46.989123 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a95001d4-fd0f-4bef-b7a9-ab2981ef1cd4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1549 microversion: 2.1 time: 0.675817 Jul 27 15:29:46.991176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 108/201] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:46 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1549 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:47.018554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:47.020317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:47.030082 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:47.030948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:47.031970 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:47.032672 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:47.062419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:47.063205 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:47.091773 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:47.096751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:47.098279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:47.098727 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:47.275421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4c40f9ac-3142-47ce-a903-bc14b46af707 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.261732 Jul 27 15:29:47.277680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 94/202] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:29:47 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:47.698463 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:47.710235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0796c5a0-8d20-4093-bdaf-85993a22d580 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.650458 Jul 27 15:29:47.713471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 109/203] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:47 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:48.735870 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:48.736750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:48.753930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:48.755089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:48.757414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:48.758067 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:49.056236 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:49.070794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5abfe083-e795-4da9-83c1-d6d2421ae991 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.337557 Jul 27 15:29:49.071792 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 95/204] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:48 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:49.871971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-7e022a08-5859-4487-a910-5203ca57d7e9 req-9103dfe7-b949-4f4b-9d72-ed7a8f29d6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba023b6d-f35a-4213-979f-652a4c79acd9", "tag": "3f864415-ce7a-4cf3-afb1-cbde9b6bb602"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:49.894986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-7e022a08-5859-4487-a910-5203ca57d7e9 req-9103dfe7-b949-4f4b-9d72-ed7a8f29d6c3 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:49.895353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-7e022a08-5859-4487-a910-5203ca57d7e9 req-9103dfe7-b949-4f4b-9d72-ed7a8f29d6c3 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:49.934628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-7e022a08-5859-4487-a910-5203ca57d7e9 req-9103dfe7-b949-4f4b-9d72-ed7a8f29d6c3 service nova] Creating event network-changed:3f864415-ce7a-4cf3-afb1-cbde9b6bb602 for instance ba023b6d-f35a-4213-979f-652a4c79acd9 on hv-cinder-84131 Jul 27 15:29:49.947351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-7e022a08-5859-4487-a910-5203ca57d7e9 req-9103dfe7-b949-4f4b-9d72-ed7a8f29d6c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081294 Jul 27 15:29:49.949076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 110/205] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:50.096931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:50.097603 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:50.132347 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:50.134119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:50.135720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:50.138478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:50.427815 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:50.444595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7adb356e-aa0a-4591-a3c5-0edf6f648cf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.353311 Jul 27 15:29:50.445548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 96/206] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:50 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:50.940367 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:50.941019 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:50.958133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:50.958595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:50.959405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:50.960512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:51.056768 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:29:51.325294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-28bcf96a-8b53-4a25-9ff9-fe175bdb69e5 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 204 len: 0 microversion: 2.1 time: 0.387970 Jul 27 15:29:51.325294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 111/207] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:29:50 2022] DELETE /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:29:51.333456 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:51.335196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:51.343075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:51.343528 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:51.344335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:51.345388 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:51.469515 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:51.470526 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:51.481151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:51.482126 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:51.489645 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:51.491158 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:51.611393 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:51.629608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-abd8b02f-3899-464e-82fd-a0a2cf789149 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1554 microversion: 2.1 time: 0.294866 Jul 27 15:29:51.629608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 97/208] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:51 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:51.775972 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:51.785918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3fdce73f-5ec4-4e00-a0d9-2e52bab64a3d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.323807 Jul 27 15:29:51.786504 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 112/209] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:51 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:52.647156 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:52.648188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:52.659577 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:52.660050 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:52.660836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:52.661265 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:52.806771 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:52.807578 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:52.820153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:52.820639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:52.821425 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:52.821853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:53.047136 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:53.058368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-030c1ed2-a3b3-44fb-bab9-5c541b8592e5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.254742 Jul 27 15:29:53.059285 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 113/210] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:52 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:53.069948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:53.094715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5f721644-d549-463d-92ab-8a1ddf28b144 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1554 microversion: 2.1 time: 0.451805 Jul 27 15:29:53.096239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 98/211] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:52 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1554 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:54.084309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:54.085959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:54.096021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:54.096837 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:54.097686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:54.101186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:54.117239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:54.118574 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:54.126202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:54.126652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:54.127469 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:54.128823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:54.262067 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:54.274561 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2a7d52e5-1bc0-48c1-a16d-981416871e9f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.196189 Jul 27 15:29:54.275766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 114/212] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:54 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:54.547969 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:54.558000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-368b0de6-1b93-4e82-b5a6-5a702ecd5ae4 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1554 microversion: 2.1 time: 0.444612 Jul 27 15:29:54.558674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 99/213] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:54 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1554 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:55.296509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:55.297875 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:55.313441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:55.314221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:55.315311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:55.315995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:55.521222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:55.535550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-65af063e-4bbc-4986-a0a2-c4da23246446 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.242097 Jul 27 15:29:55.540984 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 115/214] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:55 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:55.581806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:55.583115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:55.586669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=72 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:55.592354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:55.592817 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:55.593602 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:55.594211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:55.884351 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:55.888526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:55.899675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-13cc4d99-c082-4a4d-bb0e-a25640b30e29 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1554 microversion: 2.1 time: 0.322591 Jul 27 15:29:55.916934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 100/215] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:55 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1554 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:55.962594 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-5499344c-6fbb-43ca-8960-072ca222ae2a req-c2cb15d6-073a-4f44-9a50-dc2029e132f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4e3486-0439-4325-807e-433590eb231a", "name": "network-vif-deleted", "tag": "a260e595-5546-4217-bc37-aa09f91168bd"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:55.977434 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-5499344c-6fbb-43ca-8960-072ca222ae2a req-c2cb15d6-073a-4f44-9a50-dc2029e132f0 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:55.977881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-5499344c-6fbb-43ca-8960-072ca222ae2a req-c2cb15d6-073a-4f44-9a50-dc2029e132f0 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:56.017207 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-5499344c-6fbb-43ca-8960-072ca222ae2a req-c2cb15d6-073a-4f44-9a50-dc2029e132f0 service nova] Creating event network-vif-deleted:a260e595-5546-4217-bc37-aa09f91168bd for instance 5d4e3486-0439-4325-807e-433590eb231a on hv-cinder-84131 Jul 27 15:29:56.025603 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-5499344c-6fbb-43ca-8960-072ca222ae2a req-c2cb15d6-073a-4f44-9a50-dc2029e132f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067124 Jul 27 15:29:56.026592 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 116/216] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:56.572206 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:56.573110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:56.581364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:56.582116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:56.583743 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:56.584406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:56.792456 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:56.803354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dbf0a5bc-b89e-47e1-9953-c047d16ad15a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.248589 Jul 27 15:29:56.818000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 101/217] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:56 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:56.923503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:56.924238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:56.934030 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:56.934717 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:56.935646 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:56.936804 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:57.021607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:57.031431 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-26343d84-9183-44f4-bded-7fbf74908c33 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1345 microversion: 2.1 time: 0.112491 Jul 27 15:29:57.032028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 117/218] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:56 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:57.824992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:57.825689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:57.833286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:57.833987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:57.834922 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:57.835353 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:57.988623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:57.997580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5c730ff4-1ed4-46a8-86b5-5e43d1ff191f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.176402 Jul 27 15:29:58.004117 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 102/219] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:57 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:58.052049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:58.052666 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:58.060316 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:58.060767 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:58.061534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:58.061968 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:58.130161 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:58.139287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d5fea929-91d5-4dea-a358-2c6886a165da tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1345 microversion: 2.1 time: 0.091079 Jul 27 15:29:58.140123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 103/220] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:58 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:58.221861 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-912a0499-92d6-4111-abb8-7af6f4b870f5 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Action: 'create', calling method: .version_select at 0x7f9fe0698b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1638862773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEjFVOMZoEd6SNDMJXqBX1vyUuFwFshA9+k5rBKdlc0KF1tav9i2uHO3SQv79c/9IpM8Kk1v7yD6cklMNjPXXGDA2/a9bzRbpFkvtNas2X0lL6a9zzBlvnkbrtiOvBIcg=="}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:58.238018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-912a0499-92d6-4111-abb8-7af6f4b870f5 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for project d3fd186ce4ca4030b191309f43d43baa. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:29:58.242211 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-912a0499-92d6-4111-abb8-7af6f4b870f5 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for user d737eac8ae0343df9ace919d75596800 and project d3fd186ce4ca4030b191309f43d43baa. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:29:58.270491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-912a0499-92d6-4111-abb8-7af6f4b870f5 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.247155 Jul 27 15:29:58.271421 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 118/221] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:29:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:59.019091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:59.019703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:59.027192 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:59.027672 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:59.028461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:59.028896 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:59.161436 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:59.162079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:29:59.173311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:59.173764 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:59.174570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:59.175006 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:59.193622 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:59.197286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:59.205686 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-143e79a3-59c9-42f8-8f57-7729b87f92a9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.190793 Jul 27 15:29:59.211175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 104/222] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:59 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:59.214368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:29:59.214814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:29:59.215274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lazy-loading 'fault' on Instance uuid 5d4e3486-0439-4325-807e-433590eb231a {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:29:59.286385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1989ddc458d645af8d017987a6b93809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7c86e4b1c40ec8e4335a2770353f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:59.296030 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-17ae2300-a9b1-43db-b6a9-bad2ae7f08af tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 200 len: 1304 microversion: 2.1 time: 0.139005 Jul 27 15:29:59.297422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 119/223] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:29:59 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:00.234105 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:00.234947 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:00.250595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:00.251133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:00.252178 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:00.256643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:00.318508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:00.319101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:00.334108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:00.334662 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:00.336739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:00.338671 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:00.381687 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] HTTP exception thrown: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Request method failure captured: Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a HTTP/1.1 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmtKsx8Guy_xVUbxrCr4vZBxBHvN_LdS6so2RC0BNEOcqJw6J76GJDrDSsoBM-hypMXst__HwMb8h1dvFUfKPVwShlIuyhyOCds4Y_CHqiIE0n9LnVACNV5X-xu9Zd-fP377VN6IUW_L7IwPP3Sdv7FySm4cRG5j950wOCX1W5XvL0 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:30:00.387621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1c7c86e4b1c40ec8e4335a2770353f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 1989ddc458d645af8d017987a6b93809 Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.388906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '5d4e3486-0439-4325-807e-433590eb231a'} Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:30:00.389617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.390710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.394771 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Returning 404 to user: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:30:00.395912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a0b33eeb-6ea3-4230-b7ab-29904377c137 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 404 len: 111 microversion: 2.1 time: 0.082099 Jul 27 15:30:00.396687 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 120/224] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:00 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:30:00.469288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:00.497351 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-450c8e0a-8637-4f93-9124-50bd3aa8223a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.263234 Jul 27 15:30:00.498494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 105/225] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:00 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:00.590433 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:00.598537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:00.607165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:00.608353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:00.609397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:00.609831 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:00.659705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] HTTP exception thrown: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Request method failure captured: Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a/os-volume_attachments HTTP/1.1 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmtKsx8Guy_xVUbxrCr4vZBxBHvN_LdS6so2RC0BNEOcqJw6J76GJDrDSsoBM-hypMXst__HwMb8h1dvFUfKPVwShlIuyhyOCds4Y_CHqiIE0n9LnVACNV5X-xu9Zd-fP377VN6IUW_L7IwPP3Sdv7FySm4cRG5j950wOCX1W5XvL0 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:30:00.669544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1c7c86e4b1c40ec8e4335a2770353f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 1989ddc458d645af8d017987a6b93809 Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.670874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'server_id': '5d4e3486-0439-4325-807e-433590eb231a'} Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:30:00.672037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:00.673186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:00.677004 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Returning 404 to user: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:30:00.677004 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f7184605-2515-4046-8435-628ef8be8140 tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.085614 Jul 27 15:30:00.677004 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 121/226] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:30:00 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a/os-volume_attachments => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:30:01.523289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:01.525251 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:01.549720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:01.549720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:01.563779 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:01.564303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:01.806894 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:01.820011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-31b74a14-7b8b-4516-8575-48a96617739a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.298882 Jul 27 15:30:01.820834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 106/227] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:01 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:02.004056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:02.005170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:02.014459 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:02.015136 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:02.017033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:02.018588 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:02.065536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] HTTP exception thrown: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Request method failure captured: Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a HTTP/1.1 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmtKsx8Guy_xVUbxrCr4vZBxBHvN_LdS6so2RC0BNEOcqJw6J76GJDrDSsoBM-hypMXst__HwMb8h1dvFUfKPVwShlIuyhyOCds4Y_CHqiIE0n9LnVACNV5X-xu9Zd-fP377VN6IUW_L7IwPP3Sdv7FySm4cRG5j950wOCX1W5XvL0 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:30:02.069931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1c7c86e4b1c40ec8e4335a2770353f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 1989ddc458d645af8d017987a6b93809 Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.071435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '5d4e3486-0439-4325-807e-433590eb231a'} Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:30:02.072260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.073316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.078045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Returning 404 to user: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:30:02.080397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bc3970de-a70c-4c5e-a209-9e0bb05f889b tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 404 len: 111 microversion: 2.1 time: 0.080164 Jul 27 15:30:02.082212 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 122/228] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:30:01 2022] DELETE /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:30:02.093098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:02.093685 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] [instance: 5d4e3486-0439-4325-807e-433590eb231a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:02.111410 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:02.113264 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:02.115527 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:02.118140 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:02.144527 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] HTTP exception thrown: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Request method failure captured: Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a HTTP/1.1 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmtKsx8Guy_xVUbxrCr4vZBxBHvN_LdS6so2RC0BNEOcqJw6J76GJDrDSsoBM-hypMXst__HwMb8h1dvFUfKPVwShlIuyhyOCds4Y_CHqiIE0n9LnVACNV5X-xu9Zd-fP377VN6IUW_L7IwPP3Sdv7FySm4cRG5j950wOCX1W5XvL0 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:30:02.150680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1c7c86e4b1c40ec8e4335a2770353f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1c7c86e4b1c40ec8e4335a2770353f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: e1c7c86e4b1c40ec8e4335a2770353f5 Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1139532464 Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 1989ddc458d645af8d017987a6b93809 Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-DeleteServersTestJSON-1139532464-project Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.152331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '5d4e3486-0439-4325-807e-433590eb231a'} Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:30:02.153165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. Jul 27 15:30:02.154450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:02.155799 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] Returning 404 to user: Instance 5d4e3486-0439-4325-807e-433590eb231a could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:30:02.156013 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e5bfeb25-ed62-4073-af83-1fc6ee860b0a tempest-DeleteServersTestJSON-1139532464 tempest-DeleteServersTestJSON-1139532464-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a" status: 404 len: 111 microversion: 2.1 time: 0.069955 Jul 27 15:30:02.158381 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 107/229] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:02 2022] GET /compute/v2.1/servers/5d4e3486-0439-4325-807e-433590eb231a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:30:02.842901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:02.843521 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:02.852113 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:02.852567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:02.853342 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:02.853822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:03.082493 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:03.090980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cab84ac5-8038-480d-b199-2297ab3c70fe tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.252177 Jul 27 15:30:03.091916 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 123/230] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:02 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:04.113249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:04.113865 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:04.120168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:04.123154 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:04.123980 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:04.124417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:04.355139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:04.373794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1b558007-512e-48c2-ba40-e13bb692ed16 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.264606 Jul 27 15:30:04.375166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 108/231] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:04 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:05.402676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:05.404714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:05.414451 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:05.415257 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:05.416245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:05.416869 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:05.624448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:05.638739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b979d521-8f2e-40bf-97ed-03c0db6ba13e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.246240 Jul 27 15:30:05.639352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 124/232] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:05 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:06.667821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:06.669867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:06.682709 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:06.687198 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:06.688465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:06.690138 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:06.900883 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:06.917545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6eb6bbf5-d6d9-4fcc-87fd-47bddb6b076d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.255440 Jul 27 15:30:06.919217 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 109/233] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:06 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:07.956890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:07.957660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:07.960958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:07.979591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:07.980348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:07.983081 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:07.983530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:08.233881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:08.243188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-48c0efbe-755a-4db5-b5c3-89ecbbc58166 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.299156 Jul 27 15:30:08.257627 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 125/234] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:07 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:09.265120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:09.266349 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:09.285625 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:09.286081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:09.286863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:09.287301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:09.442481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:09.450033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cf337cef-1f8a-4609-9dce-4a1a2792444c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.189272 Jul 27 15:30:09.450591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 110/235] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:09 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:10.395476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6099ad6f-c6e5-4d9f-a4eb-9f10cc667073 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fe04e24c0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:10.402323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=4 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:10.446164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6099ad6f-c6e5-4d9f-a4eb-9f10cc667073 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b1560ff3-f713-4cb9-bfae-3de59259a4b8" status: 200 len: 350 microversion: 2.1 time: 0.054999 Jul 27 15:30:10.446823 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 126/236] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:30:10 2022] GET /compute/v2.1/os-volumes/b1560ff3-f713-4cb9-bfae-3de59259a4b8 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:10.473040 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:10.473685 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:10.480570 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:10.481118 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:10.482021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:10.482647 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:10.629593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:10.637588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f359d404-af2a-4b0f-8687-41b115060ed1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.168832 Jul 27 15:30:10.638193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 111/237] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:10 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:11.660344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:11.660947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:11.666931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:11.667372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:11.668184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:11.668614 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:11.860958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:11.868541 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1ce5beef-1aa9-4371-8680-85767195cc94 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.212604 Jul 27 15:30:11.869108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 127/238] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:11 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:11.939324 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db9846bf-fad9-4cf4-88c5-27742890c581 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fd3c56550>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:12.005555 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-db9846bf-fad9-4cf4-88c5-27742890c581 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b4367197-3544-46af-8f37-e376c1048be2" status: 200 len: 351 microversion: 2.1 time: 0.069896 Jul 27 15:30:12.006206 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 112/239] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:30:11 2022] GET /compute/v2.1/os-volumes/b4367197-3544-46af-8f37-e376c1048be2 => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:12.890819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:12.891558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:12.898841 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:12.899486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:12.900731 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:12.901235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:13.076487 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:13.085511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ff1646f2-7740-487b-8753-7957441e1f31 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.199155 Jul 27 15:30:13.086070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 128/240] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:12 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:13.382851 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-68a3d3c3-69a6-4ce1-a2af-5ead9cc5f337 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fd3c590d0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:13.478099 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-68a3d3c3-69a6-4ce1-a2af-5ead9cc5f337 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/515ca7ee-3583-4257-b358-ff03c5b13f9f" status: 200 len: 350 microversion: 2.1 time: 0.098811 Jul 27 15:30:13.478672 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 113/241] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Jul 27 15:30:13 2022] GET /compute/v2.1/os-volumes/515ca7ee-3583-4257-b358-ff03c5b13f9f => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:13.491650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c096b114-362b-47cb-b8aa-306dc4de007b tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fe04dcee0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:13.603114 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c096b114-362b-47cb-b8aa-306dc4de007b tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.115199 Jul 27 15:30:13.603883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 129/242] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Jul 27 15:30:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:13.618775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d96feb60-d80c-4c9d-bcaf-23f91fbbbafa tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fd3c62a60>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:13.722772 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d96feb60-d80c-4c9d-bcaf-23f91fbbbafa tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.109246 Jul 27 15:30:13.724073 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 114/243] 10.222.0.36 () {58 vars in 1149 bytes} [Wed Jul 27 15:30:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:13.737485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0283728f-00a4-4392-b592-9e6c745e72a1 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fe1936d30>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:13.830600 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0283728f-00a4-4392-b592-9e6c745e72a1 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096983 Jul 27 15:30:13.831169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 130/244] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Jul 27 15:30:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:13.844623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7c1ff0de-bea1-472f-8cef-d081981f134e tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fd3c56ca0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:13.955335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7c1ff0de-bea1-472f-8cef-d081981f134e tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114718 Jul 27 15:30:13.955928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 115/245] 10.222.0.36 () {58 vars in 1167 bytes} [Wed Jul 27 15:30:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:13.970096 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e845078a-416f-4b07-9a5d-8c43c3655d11 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fe04773a0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:14.071076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e845078a-416f-4b07-9a5d-8c43c3655d11 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104540 Jul 27 15:30:14.071978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 131/246] 10.222.0.36 () {58 vars in 1170 bytes} [Wed Jul 27 15:30:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:14.087260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-719d20c2-eb4f-420a-9084-b8e577113bda tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fd3c59700>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:14.116977 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:14.117781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:14.124206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:14.124857 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:14.125802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:14.126684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:14.206119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-719d20c2-eb4f-420a-9084-b8e577113bda tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.124566 Jul 27 15:30:14.206741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 116/247] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Jul 27 15:30:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:14.221120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a20ef763-f270-4c55-aed1-7ae77d6f7115 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fd3c6cee0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:14.310227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:14.318689 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e5b1600b-6bb8-4c56-8c6a-6118b1e33ba9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.213012 Jul 27 15:30:14.320152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 132/248] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:14 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:14.330823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a20ef763-f270-4c55-aed1-7ae77d6f7115 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114340 Jul 27 15:30:14.331619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 117/249] 10.222.0.36 () {58 vars in 1188 bytes} [Wed Jul 27 15:30:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:14.344437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8e144f0a-e610-4b73-895c-23a29c5d04b6 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] Calling method '.version_select at 0x7f9fe04c3b80>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:14.450629 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8e144f0a-e610-4b73-895c-23a29c5d04b6 tempest-VolumesTestJSON-197476933 tempest-VolumesTestJSON-197476933-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.110023 Jul 27 15:30:14.451987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 133/250] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Jul 27 15:30:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:15.345465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:15.346079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:15.352357 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:15.352805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:15.353566 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:15.353997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:15.497534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:15.507985 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dee5e33f-083f-483f-a90b-c3bbb2248b38 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.169775 Jul 27 15:30:15.519207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 118/251] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:15 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:16.528229 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:16.528838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:16.535525 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:16.535999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:16.536791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:16.537196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:16.676700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:16.685775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7117d279-d5b0-43d6-9255-ad1a38fb8230 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.161359 Jul 27 15:30:16.686352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 134/252] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:16 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:17.708850 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:17.709468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:17.715794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:17.716281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:17.717034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:17.717471 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:17.873675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:17.881210 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-46b15c7d-a2cf-48dc-bcd4-85f51184fec2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.176618 Jul 27 15:30:17.882025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 119/253] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:17 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:18.902987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:18.903595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:18.910929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:18.911667 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:18.912609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:18.913562 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:19.056612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:19.066749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3ab6ae1d-7f09-42c1-9a36-0e8a11302654 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1521 microversion: 2.1 time: 0.167495 Jul 27 15:30:19.067618 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 135/254] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:18 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:20.088642 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:20.089248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:20.095596 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:20.096083 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:20.097453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:20.101956 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:20.231641 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:20.240294 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fbbf1a5a-c7f8-427f-8d04-cc1f67ea5353 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1501 microversion: 2.1 time: 0.155409 Jul 27 15:30:20.240960 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 120/255] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:20 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:20.262069 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:20.262699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:20.270093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:20.270536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:20.271322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:20.271888 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:20.416906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:20.424283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9e138b31-c0b8-439c-b5bc-44f6ac0e246b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1516 microversion: 2.1 time: 0.166440 Jul 27 15:30:20.424919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 136/256] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:20 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:23.904003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:23.906170 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:23.912631 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:23.913076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:23.913856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:23.914275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:23.937613 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lazy-loading 'flavor' on Instance uuid 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:30:24.030322 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f764edfa-4b35-4719-aa0a-e67000a5775e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/action" status: 200 len: 32 microversion: 2.1 time: 0.130121 Jul 27 15:30:24.031733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 121/257] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:30:23 2022] POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/action => generated 32 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:30:24.042562 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:24.044191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:24.050752 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:24.051259 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:24.052057 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:24.052770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:24.447465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:24.454824 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ef0e4f33-a6c5-460a-a79c-a216a1057f50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.416752 Jul 27 15:30:24.455386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 137/258] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:24 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:25.477763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:25.478459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:25.485227 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:25.490607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:25.491404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:25.491874 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:25.503593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:25.665090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:25.672578 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-59c60194-4de7-4e20-b2a1-78a101c9a64d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.199625 Jul 27 15:30:25.673220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 122/259] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:25 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:26.694433 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:26.695031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:26.701075 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:26.701515 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:26.702254 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:26.702684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:26.828188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:26.835895 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ceaae4c9-3478-47b4-9bce-c04de6cad144 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.146107 Jul 27 15:30:26.836468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 138/260] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:26 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:27.857526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:27.858142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:27.860482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=34 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:27.869904 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:27.870378 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:27.871406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:27.871645 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:28.010203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:28.020934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2f77c565-24d5-4894-bc12-676acf175881 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.166480 Jul 27 15:30:28.023862 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 123/261] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:27 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:29.042937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:29.045931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:29.055041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:29.056952 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:29.058274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:29.058751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:29.224468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1771835202", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1638862773", "security_groups": [{"name": "tempest-secgroup-smoke-1358726124"}], "block_device_mapping_v2": [{"uuid": "1bedb102-394d-4285-8de3-892e52c0dada", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03d84d0-4188-403f-a4d9-b8ed9de732b3"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:29.330603 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:29.335168 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=82 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:29.352049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4b556240-96b9-4fb9-b1b5-d855a0499e60 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.313905 Jul 27 15:30:29.353480 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 139/262] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:29 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:29.413391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] validate_networks() for [('a03d84d0-4188-403f-a4d9-b8ed9de732b3', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:30:29.845957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:30:29.846420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:30:29.846897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:30:29.847334 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:30:29.847721 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:30:29.860478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:29.861155 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:29.864638 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:29.865306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:29.887078 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for project d3fd186ce4ca4030b191309f43d43baa. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:30:29.892126 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for user d737eac8ae0343df9ace919d75596800 and project d3fd186ce4ca4030b191309f43d43baa. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:30:29.962003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:30:29.964139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bedb102-394d-4285-8de3-892e52c0dada',volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:30:30.125985 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-582fe571-730c-4096-9b30-ea9aa599ba94 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.908123 Jul 27 15:30:30.126804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 124/263] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:30:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:30:30.139238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1a79305d-cce7-4bd6-9295-12fb91400334 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:30.140043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1a79305d-cce7-4bd6-9295-12fb91400334 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:30.209548 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1a79305d-cce7-4bd6-9295-12fb91400334 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:30.222678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1a79305d-cce7-4bd6-9295-12fb91400334 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1095 microversion: 2.1 time: 0.088865 Jul 27 15:30:30.223459 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 140/264] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:30 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:30.377254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:30.378381 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:30.388236 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:30.388682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:30.389457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:30.389890 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:30.618741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:30.638052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f220a0e5-4fbd-4e97-8b66-2d373212d33b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.266663 Jul 27 15:30:30.639113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 125/265] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:30 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:31.243639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:31.244327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:31.253259 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:31.254094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:31.255027 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:31.255747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:31.337351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:31.349570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5284f613-6d92-42d5-8ecb-cd069b29adfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1193 microversion: 2.1 time: 0.108151 Jul 27 15:30:31.352041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 141/266] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:31 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:31.660225 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:31.661042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:31.676346 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:31.676800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:31.677607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:31.678041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:31.931369 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:31.940879 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5d94efba-a755-498b-b49c-bc96b3ce882b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.284971 Jul 27 15:30:31.941893 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 126/267] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:31 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:32.370877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:32.371495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:32.389026 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:32.389498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:32.394498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:32.395115 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:32.645191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:32.665514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-03b372de-71e2-4e19-947a-d51f7689356e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.289217 Jul 27 15:30:32.667788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 142/268] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:32 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:32.970274 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:32.971449 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:32.982877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:32.983330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:32.984245 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:32.984860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:33.234389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:33.259324 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dff1ca47-48c4-4c18-a730-44d778c6b570 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.293769 Jul 27 15:30:33.274042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 127/269] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:32 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:33.462579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-4170f310-ff5e-4ea2-844a-79b8964203a2 req-9ecff811-011d-494c-a187-5d730f8c01ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8114946e-ea8e-4a5a-a622-f2a52620bfae", "tag": "7a2cde28-b730-487b-8c95-20bfdab253ca"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:33.486832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-4170f310-ff5e-4ea2-844a-79b8964203a2 req-9ecff811-011d-494c-a187-5d730f8c01ee service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:33.487940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-4170f310-ff5e-4ea2-844a-79b8964203a2 req-9ecff811-011d-494c-a187-5d730f8c01ee service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:33.502336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-4170f310-ff5e-4ea2-844a-79b8964203a2 req-9ecff811-011d-494c-a187-5d730f8c01ee service nova] Creating event network-changed:7a2cde28-b730-487b-8c95-20bfdab253ca for instance 8114946e-ea8e-4a5a-a622-f2a52620bfae on hv-cinder-84131 Jul 27 15:30:33.507619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-4170f310-ff5e-4ea2-844a-79b8964203a2 req-9ecff811-011d-494c-a187-5d730f8c01ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056709 Jul 27 15:30:33.508330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 143/270] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:33.687619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:33.689726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:33.701242 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1153964124", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "networks": [{"uuid": "9a60c3e0-f70d-4bc1-b81b-251995c21fe7"}]}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:33.703738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:33.704227 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:33.705068 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:33.705552 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:33.825871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] validate_networks() for [('9a60c3e0-f70d-4bc1-b81b-251995c21fe7', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:30:33.988108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:34.004280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4864dd7a-a706-4c73-b7c5-5b4a4782a0e7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.320916 Jul 27 15:30:34.007511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 128/271] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:33 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:34.287974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:34.289112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:34.299716 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:34.300546 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:34.301822 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:34.302482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:34.421786 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:30:34.422101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:30:34.422570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:30:34.423150 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:30:34.423562 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:30:34.435395 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:34.435803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:34.440883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:34.441329 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:34.463251 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Getting quotas for project 8719c555ca834c738566a2cc7684e9eb. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:30:34.468198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Getting quotas for user cd41786cce9c4b8081f3a466140d268b and project 8719c555ca834c738566a2cc7684e9eb. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:30:34.481746 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:30:34.484641 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:30:34.493989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:34.503414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3ff3e6db-84df-4e97-94a0-c32cf35052cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.225505 Jul 27 15:30:34.504471 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 129/272] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:34 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:34.537987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7016444c-5c73-4187-b06a-20594304a95b tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844233 Jul 27 15:30:34.538806 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 144/273] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:30:34.551097 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4ce8375f-156e-4f28-879f-620e6ba4cba9 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:34.552131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4ce8375f-156e-4f28-879f-620e6ba4cba9 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:34.631672 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4ce8375f-156e-4f28-879f-620e6ba4cba9 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:34.647703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4ce8375f-156e-4f28-879f-620e6ba4cba9 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1214 microversion: 2.1 time: 0.100775 Jul 27 15:30:34.648711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 130/274] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:34 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:35.026832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:35.027439 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:35.033902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:35.034346 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:35.035092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:35.035520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:35.172178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:35.181209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e8a13231-c10e-40ea-b462-0b8789140b55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.157221 Jul 27 15:30:35.181783 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 145/275] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:35 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:35.525197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:35.526563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:35.533930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:35.534420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:35.535188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:35.535623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:35.669978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:35.670630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:35.675938 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:35.676900 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:35.677368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:35.678547 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:35.678986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:35.685102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3490d2af-a3f4-4243-bcfc-2205d6cdf31b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.163734 Jul 27 15:30:35.685678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 131/276] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:35 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:35.744005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:35.752027 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-573defa0-39e6-4ba9-8352-ab89e6ae51ce tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1218 microversion: 2.1 time: 0.087378 Jul 27 15:30:35.752637 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 146/277] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:35 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:36.204784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:36.205937 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:36.212272 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:36.212725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:36.213495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:36.213934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:36.350989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:36.358598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3e111bd1-ad47-4256-89c2-fc2e786b8ba6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.157724 Jul 27 15:30:36.359167 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 132/278] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:36 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:36.706030 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:36.706599 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:36.715689 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:36.716238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:36.717025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:36.717516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:36.775400 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:36.776160 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:36.782953 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:36.784158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:36.785042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:36.785358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:36.871235 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:36.882253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4f8ab32a-9ee7-47b9-89e3-d0c255b911fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1218 microversion: 2.1 time: 0.112934 Jul 27 15:30:36.882953 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 133/279] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:36 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:36.935778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:36.948396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f6762323-ee37-41d6-a191-599bb027f9de tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.244489 Jul 27 15:30:36.948983 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 147/280] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:36 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:37.378481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:37.379106 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:37.385460 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:37.385841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:37.386617 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:37.387117 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:37.664707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:37.679372 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f1fd603f-3b25-44f1-8e14-bcdd720be5ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.302473 Jul 27 15:30:37.681741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 134/281] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:37 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:37.902678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:37.905667 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:37.911065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:37.911509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:37.912295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:37.912723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:37.969924 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:37.970841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:37.978723 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:37.979427 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:37.981800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:37.983483 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:37.984171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:37.990132 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fba3754d-cfb3-435e-afd1-79341e372328 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1266 microversion: 2.1 time: 0.091329 Jul 27 15:30:37.990940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 148/282] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:37 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:38.119490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:38.127705 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fa17a455-845c-4bc6-b819-09d9ef7fd0b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.161775 Jul 27 15:30:38.128674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 135/283] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:37 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:38.702790 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:38.703429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:38.705763 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:38.711810 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:38.712277 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:38.713039 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:38.713466 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:38.847504 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:38.855633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c3920eeb-2511-4a95-9996-90278c19c402 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.156717 Jul 27 15:30:38.856684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 149/284] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:38 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:39.012812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:39.013562 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:39.020214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.020662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:39.021431 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.021863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:39.149246 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:39.150693 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:39.157364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.157902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:39.159943 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.160627 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:39.309007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:39.318178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5f7fe630-b481-42b2-967a-45a402ef10c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.172518 Jul 27 15:30:39.320035 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 150/285] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:39 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:39.491996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:39.501603 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6e887e5d-30ad-421b-9c3a-65803616d9de tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.492770 Jul 27 15:30:39.511133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 136/286] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:39 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:39.878666 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:39.879275 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:39.886862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.887304 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:39.889043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.890402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:39.933676 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:39.953668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-1421c75a-bff6-41f7-8f2c-d10fbc88a63d req-1ddf955f-743b-4c7d-8c92-c066ae5f4430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefd188d-81bf-4a02-b710-0fb4058eda59", "tag": "a58eaf95-fffb-4596-ab5a-5f2d6745f054"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:39.980314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1421c75a-bff6-41f7-8f2c-d10fbc88a63d req-1ddf955f-743b-4c7d-8c92-c066ae5f4430 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:39.981342 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1421c75a-bff6-41f7-8f2c-d10fbc88a63d req-1ddf955f-743b-4c7d-8c92-c066ae5f4430 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:40.013488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-1421c75a-bff6-41f7-8f2c-d10fbc88a63d req-1ddf955f-743b-4c7d-8c92-c066ae5f4430 service nova] Creating event network-changed:a58eaf95-fffb-4596-ab5a-5f2d6745f054 for instance eefd188d-81bf-4a02-b710-0fb4058eda59 on hv-cinder-84131 Jul 27 15:30:40.029110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-1421c75a-bff6-41f7-8f2c-d10fbc88a63d req-1ddf955f-743b-4c7d-8c92-c066ae5f4430 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097102 Jul 27 15:30:40.030163 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 137/287] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:40.090997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:40.101119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6c80357b-d297-48fe-b968-1ee85f7d554f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.226886 Jul 27 15:30:40.101865 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 151/288] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:39 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:40.339351 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:40.340071 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:40.350402 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:40.350860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:40.356175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:40.356731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:40.526749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:40.527965 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:40.535538 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:40.536014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:40.536902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:40.537542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:40.601065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:40.611356 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fe3fafa0-eb29-402f-8af1-951d864ed5c4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.275605 Jul 27 15:30:40.613032 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 138/289] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:40 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:40.716621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:40.725886 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-07a2f8d5-0d96-44ae-a4fa-ebab31c48e11 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.205615 Jul 27 15:30:40.726476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 152/290] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:40 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:41.125668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:41.126289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:41.132885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:41.133339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:41.134103 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:41.134542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:41.290905 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:41.298979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c0ceea2f-47e9-4e02-aa63-802a57ffc4bb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.177027 Jul 27 15:30:41.299543 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 139/291] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:41 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:41.633398 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:41.633935 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:41.639763 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:41.640234 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:41.640978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:41.641404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:41.750114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:41.750728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:41.757675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:41.758128 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:41.758992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:41.759326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:41.771505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:41.779332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d7ac4daa-6768-4720-a8b3-345bb0f41ea3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.149835 Jul 27 15:30:41.779915 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 153/292] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:41 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:41.898647 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:41.906220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1be9ef56-cd27-4461-b050-a6f624fcd76d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.160635 Jul 27 15:30:41.906788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 140/293] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:41 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:42.320431 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:42.321030 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:42.326929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:42.327371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:42.328138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:42.328567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:42.459177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:42.467548 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c90b885f-db72-4a3c-90b7-db76eeadf044 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.151162 Jul 27 15:30:42.468390 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 154/294] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:42 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:42.800140 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:42.800749 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:42.808151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:42.808681 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:42.809509 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:42.810052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:42.814248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:42.928215 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:42.928858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:42.935193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:42.936073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:42.937017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:42.937516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:43.081325 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:43.084656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:43.088958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1fc31400-894f-4e62-913e-53d42955ed81 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.164660 Jul 27 15:30:43.089537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 155/295] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:42 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:43.092280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4c26bd03-326c-4599-b324-a030f780dafc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.295899 Jul 27 15:30:43.092834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 141/296] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:42 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:43.489936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:43.490542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:43.496588 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:43.497035 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:43.497790 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:43.498225 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:43.639315 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:43.648021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-77c8c9a2-33d2-4f08-85ab-a03a3ea2d7dd tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.161379 Jul 27 15:30:43.648999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 156/297] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:43 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:44.111627 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:44.112422 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:44.114552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:44.115094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:44.120139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:44.120674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:44.121535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:44.122043 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:44.122810 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:44.123241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:44.124039 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:44.124470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:44.279855 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:44.290682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-795743f0-8a51-4bd5-9b8d-55e2f6f2be15 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.184338 Jul 27 15:30:44.291464 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 142/298] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:44 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:44.295127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:44.303685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-10954538-43a6-4954-ac4d-9b3d9ab0791e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.193791 Jul 27 15:30:44.304364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 157/299] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:44 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:44.670870 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:44.671481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:44.673349 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=8 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:44.679414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:44.679887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:44.680648 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:44.681083 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:44.812948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:44.821213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7032dba4-6b91-407e-8152-039c04c71dfc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.154164 Jul 27 15:30:44.821767 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 143/300] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:44 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:45.311695 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:45.312352 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:45.314119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:45.315395 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=8 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:45.321445 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:45.321890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:45.322698 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:45.323076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:45.327330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:45.329188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:45.335383 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:45.335872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:45.336719 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:45.337163 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:45.487393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:45.490743 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=100 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:45.497915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:45.501924 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9308c3b6-9a0c-466d-98cb-b83f12c5dc14 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.193653 Jul 27 15:30:45.503116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 158/301] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:45 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:45.506633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b8699a4e-e82e-4c9f-94e4-59d6c73039fc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.184058 Jul 27 15:30:45.507345 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 144/302] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:45 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:45.841721 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:45.842355 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:45.848838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:45.849278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:45.850019 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:45.850452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:45.988348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:45.995655 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-10437abc-0d5c-4436-b53e-00ce67b99b4d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.157767 Jul 27 15:30:45.996244 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 159/303] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:45 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:46.523973 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:46.524614 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:46.526126 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:46.526732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:46.531161 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:46.531557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:46.532339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:46.532534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:46.532775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:46.532976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:46.533724 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:46.534191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:46.663383 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:46.663598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:46.670963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-df869ec7-37f7-4abc-8a6d-508d4ff687df tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.150950 Jul 27 15:30:46.671257 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-62a75c7d-edd4-48cc-acdd-7cff2905b50d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.148875 Jul 27 15:30:46.671562 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 145/304] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:46 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:46.671802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 160/305] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:46 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:46.676110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:46.676527 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:46.682345 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:46.682789 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:46.683539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:46.684006 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:46.707616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5faa0682-9d9c-4628-b5b2-cc0633321cce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/ips" status: 200 len: 146 microversion: 2.1 time: 0.035066 Jul 27 15:30:46.708190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 146/306] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:30:46 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:47.016302 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:47.016910 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:47.023070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:47.023516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:47.024296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:47.024726 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:47.156282 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:47.164105 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-131a342c-a064-4299-a0ed-56a89963cb2e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.151897 Jul 27 15:30:47.164682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 161/307] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:47 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:47.692526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:47.693062 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:47.700688 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:47.701302 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:47.706688 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:47.707145 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:47.707712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:47.708009 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:47.708201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:47.708450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:47.708973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:47.709410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:47.854632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:47.855230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:47.862088 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-72a82542-0b0e-436c-9b52-724512bc14fd tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.165098 Jul 27 15:30:47.862857 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 162/308] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:47 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:47.863176 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fb5c46bd-4891-4a19-822d-afa0ed0a94a8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.174419 Jul 27 15:30:47.863720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 147/309] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:47 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:48.185328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:48.185927 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:48.192716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.193157 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.193899 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.194333 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.291630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:48.292254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:48.298387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.298827 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.299584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.300037 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.323309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f0fc07b7-2535-4293-ae2b-030ed5af613a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/ips" status: 200 len: 151 microversion: 2.20 time: 0.036498 Jul 27 15:30:48.323657 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:48.323885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 148/310] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Jul 27 15:30:48 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:30:48.332310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cd51ce8a-8721-437f-a013-1a343f6eeda1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.150793 Jul 27 15:30:48.332843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 163/311] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:48 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:48.884057 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:48.884711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:48.885082 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:48.885212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:48.892418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.893223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.894359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.894839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.901159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.901821 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:48.902785 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:48.903373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:49.104969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:49.116189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fb2006b3-a678-459c-a8b2-7c6c221a4b03 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.235738 Jul 27 15:30:49.117579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 164/312] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:48 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:49.136293 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:49.144561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-230a1411-8170-41fc-a295-2fc0040064c4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.264314 Jul 27 15:30:49.145206 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 149/313] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:48 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:49.353292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:49.353937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:49.359986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:49.360439 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:49.361195 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:49.361634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:49.493679 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:49.501084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c617f3bc-9530-40d0-89e3-6cea371dca6d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.151653 Jul 27 15:30:49.501643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 165/314] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:49 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:50.137466 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:50.138077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:50.145157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:50.145606 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:50.146366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:50.146797 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:50.165625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:50.167012 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:50.173007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:50.173458 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:50.174225 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:50.174658 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:50.281382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:50.289640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7a912a48-e132-411a-bcf8-6f1dce20ffe6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.155949 Jul 27 15:30:50.290207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 150/315] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:50 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:50.306445 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:50.313730 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-99942cb6-70b1-4503-bef2-4235cbbaeb55 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.151877 Jul 27 15:30:50.314283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 166/316] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:50 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:50.522606 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:50.523137 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:50.529048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:50.529520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:50.530269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:50.531006 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:50.658093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:50.665552 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4ed7e530-8877-40e0-9b61-02e58b56c508 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.147378 Jul 27 15:30:50.666112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 151/317] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:50 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:51.311398 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:51.312045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:51.318191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:51.318628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:51.319367 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:51.319794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:51.334284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:51.334986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:51.341320 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:51.341769 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:51.342527 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:51.342965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:51.448071 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:51.456141 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1d9f0655-ff89-4809-b07a-c6b0c40b833d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.147967 Jul 27 15:30:51.456747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 167/318] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:51 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:51.475770 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:51.483090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-19dd9dc5-096f-4a39-9bbb-942e9ae18544 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.152577 Jul 27 15:30:51.483640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 152/319] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:51 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:51.686110 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:51.686715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:51.693490 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:51.693929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:51.694683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:51.695121 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:51.834520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:51.842165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2933dc63-12f3-40fc-88f7-71ace8ac605e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.159848 Jul 27 15:30:51.842775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 168/320] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:51 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:52.477252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:52.477943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:52.484301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.484744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:52.485525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.485955 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:52.505345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:52.506458 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:52.513330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.513909 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:52.514803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.515478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:52.622882 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:52.631190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c0e82cde-75a8-4380-a3be-45c76e56a563 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.157823 Jul 27 15:30:52.631763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 153/321] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:52 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:52.662513 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-c61973fb-c164-4ea7-bce9-9e72e4717e77 req-cc85fcbc-9fa0-4718-aa2f-ef6bbd55934b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8114946e-ea8e-4a5a-a622-f2a52620bfae", "name": "network-vif-plugged", "status": "completed", "tag": "7a2cde28-b730-487b-8c95-20bfdab253ca"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:52.664026 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:52.672204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9bf70839-ac36-4fa7-8702-aa6991b321b4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.171654 Jul 27 15:30:52.675596 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 169/322] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:52 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:52.675908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c61973fb-c164-4ea7-bce9-9e72e4717e77 req-cc85fcbc-9fa0-4718-aa2f-ef6bbd55934b service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.675908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c61973fb-c164-4ea7-bce9-9e72e4717e77 req-cc85fcbc-9fa0-4718-aa2f-ef6bbd55934b service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:52.688406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-c61973fb-c164-4ea7-bce9-9e72e4717e77 req-cc85fcbc-9fa0-4718-aa2f-ef6bbd55934b service nova] Creating event network-vif-plugged:7a2cde28-b730-487b-8c95-20bfdab253ca for instance 8114946e-ea8e-4a5a-a622-f2a52620bfae on hv-cinder-84131 Jul 27 15:30:52.694977 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-c61973fb-c164-4ea7-bce9-9e72e4717e77 req-cc85fcbc-9fa0-4718-aa2f-ef6bbd55934b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036800 Jul 27 15:30:52.696652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 154/323] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:30:52.863905 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:52.864513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:52.870741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.871454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:52.872237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:52.872844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.023228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:53.031550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f5f79bda-b301-4364-bf61-b7e75ea1100d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.172501 Jul 27 15:30:53.032161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 170/324] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:52 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:53.066490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55131777-5fbf-4618-be33-361f2b1b9a07"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:53.069612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:53.076250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.076791 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.080190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.081492 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.554295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:53.554844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:53.560921 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.561368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.562119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.562553 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.584780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lazy-loading 'flavor' on Instance uuid 0c7540c3-cdec-4257-bea3-93599c6919cc {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:30:53.825011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-00c03951-6682-4b0d-b860-44692262579c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/action" status: 202 len: 0 microversion: 2.20 time: 0.275133 Jul 27 15:30:53.827882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 171/325] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Jul 27 15:30:53 2022] POST /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:30:53.831910 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:53.832923 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:53.839229 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.839681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.840664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.841105 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.879635 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a11b5008-40a7-44f5-9ec7-4476cede1e88 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817518 Jul 27 15:30:53.880619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 155/326] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:30:53 2022] POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:53.886088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:53.887014 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:53.894576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.895196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.896262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:53.896699 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:53.989445 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:53.997245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dbebcec0-361c-40ef-ac9e-2b5654c946c5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1502 microversion: 2.1 time: 0.170510 Jul 27 15:30:53.997911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 172/327] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:53 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:54.003017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:54.003619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:54.012536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.012983 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.014188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.014635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.038962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:54.046671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.055229 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c25bb3a7-606f-4c4c-b167-1b5ec69efbc4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.173330 Jul 27 15:30:54.055999 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 156/328] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:53 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:54.063418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4966915c-6ed8-4c52-a055-a853bf4879b2"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:54.066709 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:54.073796 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.074477 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.075250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.075718 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.101713 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] HTTP exception thrown: Cannot 'attach_volume' instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 while it is in vm_state rescued Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Request method failure captured: Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/os-volume_attachments HTTP/1.1 Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 74 Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4Vmj2-Uq8N8Yexb4Xf21A8zhJi8OiiyAEh7fjMMvt05Sacnem1jbCU-7l3M9nKZ7rX5cwMHn3bBOutSk62C9Ol5QQtWZIgV98Nq7UsHiDr4JmvyYSZrYEMEoTI80yaowyGAxb05l0HUSBpB4iXN4Hwy3pc2gDVyES2r9qHll9iS_nCA Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:30:54.103678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_736d8803a13e4dddb1ef32b7ab11eb1c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 51657a0e4865469999bdf8cd5102dad1 Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {"volumeAttachment": {"volumeId": "4966915c-6ed8-4c52-a055-a853bf4879b2"}} Jul 27 15:30:54.105019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Cannot 'attach_volume' instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 while it is in vm_state rescued Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'server_id': '44a82d27-5756-4ee1-8c2e-d6a26bf75f15', 'body': {'volumeAttachment': {'volumeId': '4966915c-6ed8-4c52-a055-a853bf4879b2'}}} Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:30:54.105800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 while it is in vm_state rescued Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:30:54.107798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 while it is in vm_state rescued Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Returning 409 to user: Cannot 'attach_volume' instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 while it is in vm_state rescued {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-253dc852-2a82-4e55-96b1-3d4771f1c707 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047188 Jul 27 15:30:54.108918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 157/329] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:30:54 2022] POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 15:30:54.115996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:54.116670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:54.123583 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.123990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.124804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.125243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.130311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:54.188041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.198214 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.199819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.201108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ae39dbb4-883d-4300-bb3f-10c99d9d4172 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.202284 Jul 27 15:30:54.201729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 173/330] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:30:53 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:30:54.213281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:54.219399 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:54.226025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.226740 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.227512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.228088 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.283253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.304487 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5b972cab-3455-4426-9dba-d48649c51909 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.197695 Jul 27 15:30:54.305059 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 158/331] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:54 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:54.436365 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-374e5bbd-9d7e-4cde-87af-db8bf1b8ebd3 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/action" status: 202 len: 0 microversion: 2.1 time: 0.227158 Jul 27 15:30:54.441545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 174/332] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:30:54 2022] POST /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:30:54.450061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:54.450992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:54.459032 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.459480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.460275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.460709 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.638097 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.645694 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a8af9455-6c51-4b0f-8f7f-19817d542996 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1510 microversion: 2.1 time: 0.201891 Jul 27 15:30:54.646336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 159/333] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:54 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:54.709231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-9d636c80-f819-4fbe-8033-cf68253e8de6 req-d26806f2-4c9f-40e5-8544-8f13bd67ea8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefd188d-81bf-4a02-b710-0fb4058eda59", "name": "network-vif-plugged", "status": "completed", "tag": "a58eaf95-fffb-4596-ab5a-5f2d6745f054"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:54.719814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-9d636c80-f819-4fbe-8033-cf68253e8de6 req-d26806f2-4c9f-40e5-8544-8f13bd67ea8f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:54.720274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-9d636c80-f819-4fbe-8033-cf68253e8de6 req-d26806f2-4c9f-40e5-8544-8f13bd67ea8f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:54.731206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-9d636c80-f819-4fbe-8033-cf68253e8de6 req-d26806f2-4c9f-40e5-8544-8f13bd67ea8f service nova] Creating event network-vif-plugged:a58eaf95-fffb-4596-ab5a-5f2d6745f054 for instance eefd188d-81bf-4a02-b710-0fb4058eda59 on hv-cinder-84131 Jul 27 15:30:54.736400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-9d636c80-f819-4fbe-8033-cf68253e8de6 req-d26806f2-4c9f-40e5-8544-8f13bd67ea8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031134 Jul 27 15:30:54.737444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 175/334] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:55.081867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:55.082513 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:55.089415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.089876 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.090824 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.091363 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.225385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:55.226077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:55.231093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:55.232502 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.232991 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.233717 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.234148 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.240088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0b1f8c9f-87f4-4a31-996b-88240b4d25b3 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.162540 Jul 27 15:30:55.240757 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 160/335] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:55 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:55.325963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:55.326609 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:55.333127 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.333616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.334344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.334780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.379744 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:55.387759 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:55.389282 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:55.390474 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-29ffabdb-b54f-43ad-8d42-6de5994cbac9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.170115 Jul 27 15:30:55.391024 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 176/336] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:30:55 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:30:55.491728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:55.500091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c57ad07e-817d-437d-9be4-a94180ded544 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1267 microversion: 2.1 time: 0.177636 Jul 27 15:30:55.503886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 161/337] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:55 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:55.670239 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:55.670831 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:55.677028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.677485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.678992 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:55.679696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:55.881704 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:55.890192 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b62e084f-cc31-475c-aafe-b704d68a3d86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1510 microversion: 2.1 time: 0.223623 Jul 27 15:30:55.890676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 177/338] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:55 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:56.261646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.262504 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:56.269256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.269707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.270479 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.270918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.413149 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.414854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.415741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:56.423284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.423843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.424686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.425836 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.431082 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-61746ca3-ef05-4fe8-b5cd-fa0620b24a70 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1314 microversion: 2.1 time: 0.173371 Jul 27 15:30:56.432461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 162/339] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:56 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:56.521669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.522562 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:56.528454 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.528899 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.529665 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.530098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.570488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.581216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.582928 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.584110 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b7a27e6c-9520-473e-a5ad-c71a6df770a4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.173311 Jul 27 15:30:56.584656 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 178/340] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:30:56 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:30:56.668160 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.675787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f873e23d-1d58-48c3-97ed-2d2fd922c9e1 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1455 microversion: 2.1 time: 0.158239 Jul 27 15:30:56.676379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 163/341] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:56 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:56.696638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.697246 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:56.703143 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.703590 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.704379 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.704813 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.860558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.865198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b467bb6d-4878-4f65-bc7a-9de7f2af90c9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1455 microversion: 2.1 time: 0.172349 Jul 27 15:30:56.865973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 179/342] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:56 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:56.911995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.913032 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:56.915131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:56.921085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.922054 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:56.923691 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:56.924322 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:57.066953 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:57.075898 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-85cdd4be-f4fb-4004-bfa2-bff317b9d7b9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1510 microversion: 2.1 time: 0.168921 Jul 27 15:30:57.076456 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 164/343] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:56 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:57.455715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:57.456392 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:57.465625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:57.466190 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:57.467585 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:57.468048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:57.606957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:57.608222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:57.615556 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:57.617847 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:57.618296 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:57.619292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:57.620328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:57.624450 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d8800408-a168-4e85-b49f-f3041f799382 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1499 microversion: 2.1 time: 0.172576 Jul 27 15:30:57.625448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 180/344] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:57 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:57.884120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:57.894029 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:57.895609 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:57.896697 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f553335d-afd0-4476-a84f-a518a4313965 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.294120 Jul 27 15:30:57.917049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 165/345] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:30:57 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:30:58.098311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:58.098951 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:58.105576 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.106309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.107228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.107680 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.133021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:58.133659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:58.140086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.140533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.141291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.141721 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.170959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:30:58.279066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:58.281354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-813d16d9-14d5-406b-a8bf-2d0b5dc02dea tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 204 len: 0 microversion: 2.1 time: 0.151764 Jul 27 15:30:58.281930 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 166/346] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:30:58 2022] DELETE /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:30:58.288722 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9bebccc6-5ba3-44d8-a5fd-80baa3877571 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1510 microversion: 2.1 time: 0.195011 Jul 27 15:30:58.292632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:58.293446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:58.300474 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 181/347] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:58 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:58.300789 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.301237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.302177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.302618 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.558449 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:58.569373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ac933668-e60b-4f5e-b2ca-9ebc376dc37f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.282383 Jul 27 15:30:58.575891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 167/348] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:58 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:58.920268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:58.920879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:58.927631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.928188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:58.929037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:58.929536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:59.058117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:59.066707 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:59.068499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:59.069690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-164da90a-6a64-4f17-ab8d-74e2d310fa1a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.153483 Jul 27 15:30:59.070239 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 182/349] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:30:58 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:30:59.194677 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-0bbcd133-0e20-4d07-bbe8-e3fca5df0988 req-68aab05b-84a1-42ea-9d4d-8759a77756aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8114946e-ea8e-4a5a-a622-f2a52620bfae", "tag": "7a2cde28-b730-487b-8c95-20bfdab253ca"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:59.204603 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0bbcd133-0e20-4d07-bbe8-e3fca5df0988 req-68aab05b-84a1-42ea-9d4d-8759a77756aa service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:59.205325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0bbcd133-0e20-4d07-bbe8-e3fca5df0988 req-68aab05b-84a1-42ea-9d4d-8759a77756aa service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:59.222763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-0bbcd133-0e20-4d07-bbe8-e3fca5df0988 req-68aab05b-84a1-42ea-9d4d-8759a77756aa service nova] Creating event network-changed:7a2cde28-b730-487b-8c95-20bfdab253ca for instance 8114946e-ea8e-4a5a-a622-f2a52620bfae on hv-cinder-84131 Jul 27 15:30:59.228066 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-0bbcd133-0e20-4d07-bbe8-e3fca5df0988 req-68aab05b-84a1-42ea-9d4d-8759a77756aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038326 Jul 27 15:30:59.228660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 168/350] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:59.310525 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:59.311246 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:59.317936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:59.318460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:59.319294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:59.319766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:59.457003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:59.464564 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6eb58374-3508-423c-ad22-f3f02789c036 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1516 microversion: 2.1 time: 0.157896 Jul 27 15:30:59.465127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 183/351] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:59 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:59.593099 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:59.593996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:30:59.600996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:59.601568 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:59.602564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:30:59.603247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:30:59.783557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:59.793331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b52f5814-71a4-4b6a-950a-31ddae8e818d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.204267 Jul 27 15:30:59.794056 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 169/352] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:30:59 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:00.092913 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:00.093623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:00.100775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:00.101542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:00.102456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:00.103036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:00.230838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:00.239233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:00.241034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:00.242892 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cfc9bc28-ad03-4029-9564-8de71800677c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.154176 Jul 27 15:31:00.243481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 184/353] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:00 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:00.814637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:00.815790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:00.822011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:00.822463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:00.823218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:00.823703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:00.953486 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:00.960977 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88dd8f5c-fc5e-477c-9d38-e05ce1e63c71 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.150578 Jul 27 15:31:00.961528 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 170/354] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:00 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:01.266547 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:01.267159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:01.273804 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:01.274258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:01.275021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:01.275459 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:01.401750 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:01.410267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:01.411773 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:01.412974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4c44c8c1-d464-4fd6-a8e1-a2ff481c0594 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.150333 Jul 27 15:31:01.413508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 185/355] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:01 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:01.982181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:01.982917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:01.990189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:01.990716 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:01.991541 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:01.992073 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:02.125885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:02.133282 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b6c28d41-2c7f-4e91-b303-54e914a67664 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.154979 Jul 27 15:31:02.133849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 171/356] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:01 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:02.435938 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:02.436577 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:02.443357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:02.443802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:02.444585 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:02.445022 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:02.573511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:02.582022 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:02.583665 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:02.584908 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9c11996e-6155-4b18-a4c4-0a32d6de0081 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.152971 Jul 27 15:31:02.585643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 186/357] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:02 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:03.154416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:03.155089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:03.163044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:03.163492 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:03.164297 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:03.164735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:03.295424 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:03.303476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-903257f6-846e-4622-aeaa-8fa4740fcc4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.153009 Jul 27 15:31:03.304061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 172/358] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:03 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:03.607738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:03.608375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:03.614380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:03.614831 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:03.615593 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:03.616063 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:03.748218 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:03.756481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:03.757965 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:03.759117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-386d75ae-88c3-4366-bf8e-3b9af2a90695 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.155268 Jul 27 15:31:03.759665 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 187/359] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:03 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:04.325143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:04.325758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:04.332269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:04.332715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:04.333465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:04.333897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:04.463091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:04.466612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:04.473001 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e077e16b-ef9a-4c6a-a849-dcd8928609b1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.151694 Jul 27 15:31:04.473568 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 173/360] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:04 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:04.782221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:04.782959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:04.789514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:04.789956 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:04.790700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:04.791125 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:04.924972 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:04.933001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:04.934439 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:04.935590 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5f2fff6a-ad7d-4233-b959-7b8319c695a5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.157379 Jul 27 15:31:04.936181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 188/361] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:04 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:05.493465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:05.494079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:05.501682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:05.502123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:05.503423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:05.503877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:05.630760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:05.638196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-45b6b5c5-87d1-4d8f-8283-adefbc1075d8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.148504 Jul 27 15:31:05.638754 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 174/362] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:05 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:05.960123 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:05.960754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:05.967086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:05.967799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:05.968576 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:05.969001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:06.111769 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3b02a0ba-4a13-4f75-a949-00325d5888d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'create', calling method: .version_select at 0x7f9fd3c590d0>, body: {"keypair": {"name": "tempest-keypair-1206466831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpfDm86b4AQij/8hsQHkhjkveKMaBpjLTCxzSu6ZRTagoeAc6MY5JR4+ANVFAWbJ3Ji7g0MciyV+xgYdzggY/WgyaxtqwYFkEOgPjWBTBGqfDq7jNdPTnFzLhqZI+JgWA=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:06.118437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:06.120796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:06.128064 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:06.128234 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-3b02a0ba-4a13-4f75-a949-00325d5888d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:31:06.129574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:06.130733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e625e3fa-d0d6-4d4a-8ca7-3b27c0ee5f92 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.175148 Jul 27 15:31:06.131471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 189/363] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:05 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:06.132239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-3b02a0ba-4a13-4f75-a949-00325d5888d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for user 51657a0e4865469999bdf8cd5102dad1 and project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:31:06.154457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3b02a0ba-4a13-4f75-a949-00325d5888d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046682 Jul 27 15:31:06.155169 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 175/364] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:31:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:06.659893 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:06.660506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:06.668466 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:06.669095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:06.670056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:06.670498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:07.029580 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:07.037770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-30e67095-2e83-4427-bfc6-88ee56765cdc tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.383120 Jul 27 15:31:07.038332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 190/365] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:06 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:07.155028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:07.155634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:07.161607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:07.162046 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:07.162801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:07.163232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:07.305547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:07.313723 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:07.315884 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:07.317502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2ea66876-7957-4e11-a331-0cd047f36aeb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.166917 Jul 27 15:31:07.318048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 176/366] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:07 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:07.758095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-190524817", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54d4d7af-884d-4461-b1ad-55fbebbc888a"}], "security_groups": [{"name": "tempest-securitygroup--325980671"}], "key_name": "tempest-keypair-1206466831", "user_data": "}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:07.858006 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] validate_networks() for [('54d4d7af-884d-4461-b1ad-55fbebbc888a', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:31:08.058863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:08.059454 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:08.065941 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:08.066384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:08.067395 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:08.067820 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:08.275750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:08.283646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-841b04bc-c00b-486b-801e-b3585ac3b094 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1505 microversion: 2.1 time: 0.228535 Jul 27 15:31:08.284972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 177/367] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:08 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:08.341076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:08.341776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:08.348406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:08.348920 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:08.349766 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:08.350259 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:08.402192 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:31:08.402664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:31:08.403039 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:31:08.403447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:31:08.404194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:31:08.415245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:08.416005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:08.417086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:08.417476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:08.436430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:31:08.440711 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Getting quotas for user 51657a0e4865469999bdf8cd5102dad1 and project 736d8803a13e4dddb1ef32b7ab11eb1c. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:31:08.453113 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:31:08.455681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:31:08.479009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:08.492220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:08.500989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:08.502757 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:08.504149 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6681c09a-43e5-457f-9ac1-449d899ff066 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.166946 Jul 27 15:31:08.516925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-db53b00a-dc4c-4dd4-b688-c581fae735d5 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.756280 Jul 27 15:31:08.516925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 191/368] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:31:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:31:08.517521 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 178/369] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:08 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:08.522284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-79dd56d0-2110-409c-99bc-81b3cdc0c839 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:08.522889 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-79dd56d0-2110-409c-99bc-81b3cdc0c839 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:08.629643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-79dd56d0-2110-409c-99bc-81b3cdc0c839 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:08.638491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-79dd56d0-2110-409c-99bc-81b3cdc0c839 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1245 microversion: 2.1 time: 0.119238 Jul 27 15:31:08.639414 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 192/370] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:08 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:08.981874 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-3b270ae9-8d0a-4e6f-a8b4-3389dd08a225 req-21cac94c-7a81-4b5c-8112-b4ff6e1cd3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefd188d-81bf-4a02-b710-0fb4058eda59", "name": "network-vif-deleted", "tag": "a58eaf95-fffb-4596-ab5a-5f2d6745f054"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:08.999885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3b270ae9-8d0a-4e6f-a8b4-3389dd08a225 req-21cac94c-7a81-4b5c-8112-b4ff6e1cd3f7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.001259 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3b270ae9-8d0a-4e6f-a8b4-3389dd08a225 req-21cac94c-7a81-4b5c-8112-b4ff6e1cd3f7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.028633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-3b270ae9-8d0a-4e6f-a8b4-3389dd08a225 req-21cac94c-7a81-4b5c-8112-b4ff6e1cd3f7 service nova] Creating event network-vif-deleted:a58eaf95-fffb-4596-ab5a-5f2d6745f054 for instance eefd188d-81bf-4a02-b710-0fb4058eda59 on hv-cinder-84131 Jul 27 15:31:09.041215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-3b270ae9-8d0a-4e6f-a8b4-3389dd08a225 req-21cac94c-7a81-4b5c-8112-b4ff6e1cd3f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063291 Jul 27 15:31:09.046109 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 179/371] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:09.129374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-829dffae-5be6-4356-b270-32641c15334d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:09.135789 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-829dffae-5be6-4356-b270-32641c15334d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.136282 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-829dffae-5be6-4356-b270-32641c15334d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.197025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-829dffae-5be6-4356-b270-32641c15334d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Going to try to stop instance {{(pid=117869) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 15:31:09.246443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-829dffae-5be6-4356-b270-32641c15334d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action" status: 202 len: 0 microversion: 2.1 time: 0.121624 Jul 27 15:31:09.247218 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 193/372] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:31:09 2022] POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:31:09.267309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:09.268826 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:09.276736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.278258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.279208 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.282438 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.308586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:09.309690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:09.319152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.319686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.320571 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.321060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.359955 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.360395 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.361050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lazy-loading 'fault' on Instance uuid eefd188d-81bf-4a02-b710-0fb4058eda59 {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:31:09.415058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:09.441067 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1aca404c-e0ec-42df-8015-bca71ad1d9c1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 200 len: 1304 microversion: 2.1 time: 0.139981 Jul 27 15:31:09.442780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 194/373] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:09 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:09.450598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:09.463920 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-203e63a5-4165-479b-87ed-06a1eedb620a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.204558 Jul 27 15:31:09.465463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 180/374] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:09 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:09.531151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:09.531854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:09.539673 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.540174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.541187 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.541626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.662339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:09.664217 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:09.672917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.673978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.675719 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:09.676391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:09.718693 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:09.727871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:09.729720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:09.730921 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cdbebb12-c069-41cb-8601-9f2982c37146 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.205734 Jul 27 15:31:09.731473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 195/375] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:09 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:09.764717 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:09.772370 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-63ce6b00-ff6b-40cb-a6fc-513b3c05a628 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1297 microversion: 2.1 time: 0.114398 Jul 27 15:31:09.773133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 181/376] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:09 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1297 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:10.463047 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:10.464013 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: eefd188d-81bf-4a02-b710-0fb4058eda59] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:10.470619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.471635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.472505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.473003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.487707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:10.488364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:10.490765 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] HTTP exception thrown: Instance eefd188d-81bf-4a02-b710-0fb4058eda59 could not be found. Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Request method failure captured: Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 HTTP/1.1 Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VoXm-kgRIlFzAcGLFNYzYb-WWo2GNQFqyEJPswnLzgQrzK1v2YlRdmAEbbX46levgMlqZWiHBRtVMCOx_URzypQRUIPznH84KZZ57vRuKIMJSg8xZEUR_Q_SC3CTz0X7KXP92K8WSeEzf3NTs6oAGMvsRqNME8py6wwo8BEEwA89Nc Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 8719c555ca834c738566a2cc7684e9eb Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesActionsTest-205173318 Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:31:10.492532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8719c555ca834c738566a2cc7684e9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8719c555ca834c738566a2cc7684e9eb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8719c555ca834c738566a2cc7684e9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8719c555ca834c738566a2cc7684e9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesActionsTest-205173318 Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 8719c555ca834c738566a2cc7684e9eb Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesActionsTest-205173318 Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesActionsTest-205173318-project Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: cd41786cce9c4b8081f3a466140d268b Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesActionsTest-205173318-project Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance eefd188d-81bf-4a02-b710-0fb4058eda59 could not be found. Jul 27 15:31:10.493735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'eefd188d-81bf-4a02-b710-0fb4058eda59'} Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefd188d-81bf-4a02-b710-0fb4058eda59 could not be found. Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:31:10.494505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefd188d-81bf-4a02-b710-0fb4058eda59 could not be found. Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefd188d-81bf-4a02-b710-0fb4058eda59 could not be found. Jul 27 15:31:10.495653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:10.497179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Returning 404 to user: Instance eefd188d-81bf-4a02-b710-0fb4058eda59 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:31:10.497179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1293d796-fa38-41a7-97d7-326cb8b50ea4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59" status: 404 len: 111 microversion: 2.1 time: 0.035121 Jul 27 15:31:10.497326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.497326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.497756 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 196/377] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:10 2022] GET /compute/v2.1/servers/eefd188d-81bf-4a02-b710-0fb4058eda59 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:31:10.507605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.508159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.623004 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-633766011", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "networks": [{"uuid": "9a60c3e0-f70d-4bc1-b81b-251995c21fe7"}]}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:10.661705 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:10.675703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9a80401a-7778-4cfb-bb9c-d8a9a3c49ef0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.189740 Jul 27 15:31:10.676365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 182/378] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:10 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:10.706256 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] validate_networks() for [('9a60c3e0-f70d-4bc1-b81b-251995c21fe7', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:31:10.754942 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:10.755659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:10.762325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.762776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.763605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.764098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.902379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:10.911231 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:10.912750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:10.913897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-33599a7f-2d10-4a3a-8972-a4a7883cc7ba tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.163351 Jul 27 15:31:10.924193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 183/379] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:10 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:10.934917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:10.935521 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:10.941958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.942715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:10.943688 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:10.944162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:11.013435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:11.021231 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e7c9b11c-8d50-48c4-a0a3-3416dc39f3d0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1297 microversion: 2.1 time: 0.095976 Jul 27 15:31:11.021799 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 184/380] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:10 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:11.097782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:31:11.098193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:31:11.098653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:31:11.099073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:31:11.099473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:31:11.110058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:11.110503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:11.111281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:11.112594 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:11.129607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Getting quotas for project 8719c555ca834c738566a2cc7684e9eb. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:31:11.133506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Getting quotas for user cd41786cce9c4b8081f3a466140d268b and project 8719c555ca834c738566a2cc7684e9eb. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:31:11.145604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:31:11.147849 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:31:11.194166 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8341d758-faf9-4969-8314-aa69ad0e2f4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575404 Jul 27 15:31:11.200823 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 197/381] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:31:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:31:11.205525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b78907dd-48c5-483c-9ab5-04122f701dd1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:11.206137 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b78907dd-48c5-483c-9ab5-04122f701dd1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:11.265966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b78907dd-48c5-483c-9ab5-04122f701dd1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:11.272704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b78907dd-48c5-483c-9ab5-04122f701dd1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1213 microversion: 2.1 time: 0.070954 Jul 27 15:31:11.273448 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 185/382] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:11 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:11.697041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:11.697657 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:11.704719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:11.705176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:11.706456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:11.706902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:11.845179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:11.853647 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-89d6d090-1ed6-466a-91f7-f198ced3c147 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.160429 Jul 27 15:31:11.854189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 198/383] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:11 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:11.939793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:11.940412 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:11.947978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:11.948423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:11.949191 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:11.949623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:12.042636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:12.043244 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:12.050496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:12.050764 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:12.051928 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:12.052772 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:12.093291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:12.103367 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:12.105015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:12.106172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7996c7b6-ed59-49b9-bbfb-a97f94f5fc31 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.170248 Jul 27 15:31:12.120096 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 186/384] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:11 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:12.123080 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:12.132124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-96976c2a-4056-469b-8fd9-05a3ae9213b4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1297 microversion: 2.1 time: 0.093701 Jul 27 15:31:12.132901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 199/385] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:12 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:12.295367 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:12.295813 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:12.302021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:12.302468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:12.303222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:12.303660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:12.366551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:12.373997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8253d1e9-efd2-4151-ab01-66b92445ad4c tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1217 microversion: 2.1 time: 0.082547 Jul 27 15:31:12.374564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 187/386] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:12 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:12.874680 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:12.875289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:12.881615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:12.882059 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:12.882822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:12.883247 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.105554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:13.122656 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-225132eb-532a-46ae-8e34-bf91cf743e41 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.251740 Jul 27 15:31:13.123235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 200/387] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:12 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:13.129832 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:13.130452 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:13.137040 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:13.137348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.138202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:13.138811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.154294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:13.155578 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:13.164119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:13.164883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.165338 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:13.165775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.247929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:13.256454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0dedff9d-98ed-4daa-98fd-c6425b156138 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1303 microversion: 2.1 time: 0.106453 Jul 27 15:31:13.257139 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 201/388] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:13 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:13.317012 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:13.325693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:13.327562 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:13.328916 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-faf38bb1-1f59-43ee-92b5-28a2c9a40d33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.202873 Jul 27 15:31:13.329296 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 188/389] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:13 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:13.399812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:13.400616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:13.406623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:13.407074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.407866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:13.408301 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:13.474891 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:13.484461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-588d39da-7034-4a13-9a22-61ef3eb82088 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1265 microversion: 2.1 time: 0.092053 Jul 27 15:31:13.485033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 202/390] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:13 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:14.145308 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:14.145923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:14.154779 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.156432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.158265 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.158966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.285440 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:14.288180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:14.303245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.305072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.305892 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.306440 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.454258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:14.468113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5ca410e8-0bf3-43b1-ac00-b8e16b01f48a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.327469 Jul 27 15:31:14.468717 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 189/391] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:14 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:14.486404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:14.490846 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:14.497276 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.497758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.498844 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.499458 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.819371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:14.820015 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:14.833740 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:14.835778 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:14.837240 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8108b43e-11cc-406d-93ab-8eb872754bcf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.367591 Jul 27 15:31:14.837990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 190/392] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:14 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:14.838888 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9102c985-dd40-4d86-9fa1-4734a2c585e2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.559180 Jul 27 15:31:14.839855 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 203/393] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:14 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:14.844560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:14.845166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:14.852335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.852966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:14.853897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:14.854595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.054006 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:15.061999 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08733cc9-5297-40f9-a0c1-3bf20aca161a tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.221697 Jul 27 15:31:15.063204 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 191/394] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:14 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:15.383491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-b7d48fbe-5aeb-4a74-8a78-63d19bc79542 req-af9465e2-bdf2-4c69-b77d-9c396bcae5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a2ca90-8534-41a1-b3e4-4a02f4deba86", "tag": "074b3654-7c9f-4b7d-9969-0aac69d537aa"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:15.412113 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-b7d48fbe-5aeb-4a74-8a78-63d19bc79542 req-af9465e2-bdf2-4c69-b77d-9c396bcae5c0 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.412746 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-b7d48fbe-5aeb-4a74-8a78-63d19bc79542 req-af9465e2-bdf2-4c69-b77d-9c396bcae5c0 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.434160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-b7d48fbe-5aeb-4a74-8a78-63d19bc79542 req-af9465e2-bdf2-4c69-b77d-9c396bcae5c0 service nova] Creating event network-changed:074b3654-7c9f-4b7d-9969-0aac69d537aa for instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 on hv-cinder-84131 Jul 27 15:31:15.443310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-b7d48fbe-5aeb-4a74-8a78-63d19bc79542 req-af9465e2-bdf2-4c69-b77d-9c396bcae5c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064741 Jul 27 15:31:15.446053 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 204/395] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:15.490465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:15.491081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:15.498255 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.499079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.500623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.501804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.812133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:15.822553 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-34516b8a-47be-4029-8705-f49cde5f54ab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.335619 Jul 27 15:31:15.836522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 192/396] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:15 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:15.864848 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:15.865454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:15.869001 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:15.869927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:15.873870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.874696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.875898 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.876705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.877438 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.877895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.878961 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:15.879457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:15.907129 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:16.102464 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:16.110887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-26441972-8921-4e26-8a13-51d36c3921fa tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.246161 Jul 27 15:31:16.122503 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 193/397] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:15 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:16.131776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-a98a2b16-71ff-4aa1-9958-a87039aed679 req-ff3f6b37-46ec-4cf6-9811-c7a21de423cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999cce74-ed7b-47f2-876e-4057dd968208", "tag": "6a722c74-0274-458f-af51-1788f0f2a28c"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:16.142567 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-a98a2b16-71ff-4aa1-9958-a87039aed679 req-ff3f6b37-46ec-4cf6-9811-c7a21de423cc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:16.143535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-a98a2b16-71ff-4aa1-9958-a87039aed679 req-ff3f6b37-46ec-4cf6-9811-c7a21de423cc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:16.159872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-a98a2b16-71ff-4aa1-9958-a87039aed679 req-ff3f6b37-46ec-4cf6-9811-c7a21de423cc service nova] Creating event network-changed:6a722c74-0274-458f-af51-1788f0f2a28c for instance 999cce74-ed7b-47f2-876e-4057dd968208 on hv-cinder-84131 Jul 27 15:31:16.165573 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-a98a2b16-71ff-4aa1-9958-a87039aed679 req-ff3f6b37-46ec-4cf6-9811-c7a21de423cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038100 Jul 27 15:31:16.166735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 194/398] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:16.180275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:16.181142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:16.191994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:16.192572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:16.193462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:16.194392 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:16.212127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:16.226818 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:16.228930 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:16.230404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0113b867-ecb4-42d7-99f8-5cb743e2aeaf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1744 microversion: 2.20 time: 0.372498 Jul 27 15:31:16.231495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 205/399] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:15 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1744 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:16.576729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:16.585871 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7a816552-4e2a-4a97-b538-cd632b7577b8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.417724 Jul 27 15:31:16.586357 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 195/400] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:16 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:16.845375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:16.846478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:16.858633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:16.859231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:16.860404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:16.860920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.018638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:17.026913 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7982a4fa-3e89-47c3-86bd-b504e261c316 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.185391 Jul 27 15:31:17.027565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 206/401] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:16 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:17.133436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:17.134162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:17.140483 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:17.140931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.141696 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:17.142132 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.259586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:17.260481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:17.266922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:17.267488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.269043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:17.269733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.276649 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:17.285246 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d0017153-0ebd-4968-aaea-ca5ea07bcda8 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.155193 Jul 27 15:31:17.285404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 196/402] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:17 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:17.402469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:17.410633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:17.412174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:17.413335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8b7cb964-ace0-4b56-9514-0f611a14e958 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1744 microversion: 2.20 time: 0.158204 Jul 27 15:31:17.413887 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 207/403] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:17 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:17.606680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:17.607296 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:17.614274 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:17.614715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.615646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:17.616255 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:17.870887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:17.878971 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cd7d4a66-a3c0-4332-a43f-22486f4d25c6 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.276430 Jul 27 15:31:17.879532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 197/404] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:17 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:18.055316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:18.056058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:18.062658 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.063088 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.063871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.064305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.202302 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:18.204851 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:18.214579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ba07201f-0a92-4fb1-a8cd-bf17a13a1e9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.163310 Jul 27 15:31:18.215191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 208/405] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:18 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:18.305453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:18.306086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:18.312133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.312574 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.313318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.313748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.437457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:18.438282 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:18.446581 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.447023 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.447687 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:18.447819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.448364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.456342 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-effc93ec-ef04-4e05-8ece-afdd4009544b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.153754 Jul 27 15:31:18.457195 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 198/406] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:18 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:18.591529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:18.600038 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:18.601826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:18.602743 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f6a64303-daf6-45d1-83bb-e7d1d31e7a75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1744 microversion: 2.20 time: 0.169569 Jul 27 15:31:18.603468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 209/407] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:18 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:18.891153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-68c4d5b9-9d78-49df-80c2-841d26cc86b7 req-4c352e87-de41-4975-a4d8-c5bdc062c09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "name": "network-vif-plugged", "status": "completed", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:18.899605 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:18.900537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:18.901924 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-68c4d5b9-9d78-49df-80c2-841d26cc86b7 req-4c352e87-de41-4975-a4d8-c5bdc062c09b service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.902368 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-68c4d5b9-9d78-49df-80c2-841d26cc86b7 req-4c352e87-de41-4975-a4d8-c5bdc062c09b service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.906985 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.907643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.908898 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:18.909570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:18.918108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-68c4d5b9-9d78-49df-80c2-841d26cc86b7 req-4c352e87-de41-4975-a4d8-c5bdc062c09b service nova] Creating event network-vif-plugged:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:31:18.923432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-68c4d5b9-9d78-49df-80c2-841d26cc86b7 req-4c352e87-de41-4975-a4d8-c5bdc062c09b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036005 Jul 27 15:31:18.924941 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 199/408] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:19.104465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:19.116028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0f14f782-1406-4a88-a12d-43e0ac623636 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.220171 Jul 27 15:31:19.116631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 210/409] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:18 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:19.239127 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:19.240158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:19.258852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:19.261702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:19.268424 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:19.268918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:19.480350 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:19.481495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:19.493276 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:19.493714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:19.494246 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:19.495020 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:19.495458 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:19.505266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c4b810e9-15fc-40b2-a86b-df950b6d97ae tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.271817 Jul 27 15:31:19.506599 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 200/410] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:19 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:19.631632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:19.633525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:19.654524 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:19.655421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:19.656425 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:19.656959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:19.779171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:19.788192 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e86da046-8e3f-42ae-9e28-3bd099350952 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.312931 Jul 27 15:31:19.789299 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 211/411] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:19 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:19.845084 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:19.858619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:19.860662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:19.862711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a8717ad8-6f49-4679-9df3-8981913e94e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.239744 Jul 27 15:31:19.863642 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 201/412] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:19 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:20.140896 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:20.142153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:20.151202 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.152086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.153610 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.154247 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.388230 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:20.397588 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2eff2691-fa4d-4284-a443-c537c1b7ccd4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.263199 Jul 27 15:31:20.398181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 212/413] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:20 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:20.531421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:20.532729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:20.541705 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.542419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.543392 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.544030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.727811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:20.737194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e07c3656-fffe-46ba-b140-b75718921b9d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.210073 Jul 27 15:31:20.738258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 202/414] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:20 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:20.833497 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:20.834341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:20.847623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.848107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.849140 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.849866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.886703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:20.887695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:20.914139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.915189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:20.919043 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:20.920551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:21.060240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:21.069373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3b2368e1-c94d-491f-9530-aaeabef3b07b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.248822 Jul 27 15:31:21.071897 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 213/415] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:20 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:21.076749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-cf4fb6a1-5cc9-4437-ad63-37a2590e6850 req-5737516c-8a4b-4e11-9e03-b861644d33d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a2ca90-8534-41a1-b3e4-4a02f4deba86", "name": "network-vif-plugged", "status": "completed", "tag": "074b3654-7c9f-4b7d-9969-0aac69d537aa"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:21.088876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-cf4fb6a1-5cc9-4437-ad63-37a2590e6850 req-5737516c-8a4b-4e11-9e03-b861644d33d8 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:21.089970 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-cf4fb6a1-5cc9-4437-ad63-37a2590e6850 req-5737516c-8a4b-4e11-9e03-b861644d33d8 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:21.113236 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-cf4fb6a1-5cc9-4437-ad63-37a2590e6850 req-5737516c-8a4b-4e11-9e03-b861644d33d8 service nova] Creating event network-vif-plugged:074b3654-7c9f-4b7d-9969-0aac69d537aa for instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 on hv-cinder-84131 Jul 27 15:31:21.120473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-cf4fb6a1-5cc9-4437-ad63-37a2590e6850 req-5737516c-8a4b-4e11-9e03-b861644d33d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046955 Jul 27 15:31:21.122770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 214/416] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:21.236607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:21.247467 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:21.249018 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:21.250364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6659b17f-4b75-4c51-9707-3d543576bb59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.367504 Jul 27 15:31:21.250765 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 203/417] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:20 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:21.418457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=4 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:21.427306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=14 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:21.437636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:21.438437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:21.459651 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:21.460290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:21.461402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:21.462030 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:21.664491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:21.672888 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fe1bd0dc-aa63-4bfa-894b-a604aac372f1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.255282 Jul 27 15:31:21.676212 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 215/418] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:21 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:21.760497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:21.761158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:21.765766 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:21.774840 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:21.775286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:21.776102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:21.776706 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.026269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:22.035472 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a78706bb-9d8f-43b1-b720-d8ac51f19297 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.279110 Jul 27 15:31:22.037649 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 204/419] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:21 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:22.094478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:22.095087 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:22.112811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:22.113551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.114324 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:22.114933 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.275151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:22.276274 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:22.290278 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:22.294424 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:22.295285 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.300113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:22.300986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.342460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:22.352814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6d6680d3-23e3-4805-ab1b-72b84c9eaf95 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1370 microversion: 2.1 time: 0.262066 Jul 27 15:31:22.356332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 216/420] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:22 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:22.507264 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:22.516048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:22.518003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:22.519465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-71788bb1-e8ec-4ee2-961e-3a0550954b75 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.248368 Jul 27 15:31:22.520242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 205/421] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:22 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:22.699244 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:22.699885 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:22.709969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:22.710513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.711535 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:22.712001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:22.933412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:22.942813 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-638a77e1-3036-4a27-875e-ffab2414e4ab tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.248272 Jul 27 15:31:22.961721 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 217/422] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:22 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:23.070006 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:23.071252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:23.077827 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.078622 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.079626 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.080935 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.145417 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-56be2809-b346-4dd0-a838-3c96082b5aa2 req-a6eecb3b-1c8b-4e11-a131-82817f46817d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999cce74-ed7b-47f2-876e-4057dd968208", "name": "network-vif-plugged", "status": "completed", "tag": "6a722c74-0274-458f-af51-1788f0f2a28c"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:23.155043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-56be2809-b346-4dd0-a838-3c96082b5aa2 req-a6eecb3b-1c8b-4e11-a131-82817f46817d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.155491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-56be2809-b346-4dd0-a838-3c96082b5aa2 req-a6eecb3b-1c8b-4e11-a131-82817f46817d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.168037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-56be2809-b346-4dd0-a838-3c96082b5aa2 req-a6eecb3b-1c8b-4e11-a131-82817f46817d service nova] Creating event network-vif-plugged:6a722c74-0274-458f-af51-1788f0f2a28c for instance 999cce74-ed7b-47f2-876e-4057dd968208 on hv-cinder-84131 Jul 27 15:31:23.182504 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-56be2809-b346-4dd0-a838-3c96082b5aa2 req-a6eecb3b-1c8b-4e11-a131-82817f46817d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032111 Jul 27 15:31:23.183583 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 218/423] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:31:23.234549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:23.243425 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e2242053-b84e-4ae7-a3cd-e983bad0880d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.177842 Jul 27 15:31:23.244049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 206/424] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:23 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:23.375008 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:23.375706 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:23.384396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.385179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.386210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.386852 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.530912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:23.540692 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-200f0ae7-b520-43e2-a792-163d6ec11de4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1564 microversion: 2.1 time: 0.169866 Jul 27 15:31:23.541452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 219/425] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:23 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:23.546471 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:23.547090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:23.557879 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.561811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:23.562161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:23.564867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.569826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.569826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.570528 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.571210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.571915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.572544 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.680587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-074c4654-5213-44a5-b220-55388708f30f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123179 Jul 27 15:31:23.681425 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 220/426] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:31:23 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:23.777904 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:23.787271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:23.789380 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:23.790785 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d1fa67c2-1208-4c0e-8e87-d2677e3d4a88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.251746 Jul 27 15:31:23.791979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 207/427] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:23 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:23.967514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:23.969639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:23.976696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.982836 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:23.983666 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:23.984150 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:24.267011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:24.269001 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:24.278753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:24.279492 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:24.280521 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:24.281348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:24.363128 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:24.370893 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c48f4efb-22cf-4d9a-8302-689ffe9a7f7f tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.409586 Jul 27 15:31:24.371462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 221/428] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:23 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:24.553339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:24.562942 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ffdeb670-075a-480c-8298-8fb5ef5ce38c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.301092 Jul 27 15:31:24.566112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 208/429] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:24 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:24.815733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:24.816684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:24.825653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:24.826595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:24.827616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:24.828257 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:25.179013 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:25.197797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:25.200523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:25.201821 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-44a16ba9-4ee7-4d29-8117-d8f80ce3bba1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.390622 Jul 27 15:31:25.202373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 222/430] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:24 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:25.391956 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:25.394858 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:25.403122 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:25.404525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:25.405917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:25.406865 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:25.588799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:25.589761 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:25.607931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:25.608634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:25.611490 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:25.612197 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:25.690283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:25.703464 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8c100df6-f08f-49ae-9213-32f6006c9103 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.313416 Jul 27 15:31:25.705452 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 209/431] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:25 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:25.825330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-0ec29e52-dca1-4df9-b60d-90e82ba89a9b req-c2586661-16b5-484a-922f-3496ecf59b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a2ca90-8534-41a1-b3e4-4a02f4deba86", "tag": "074b3654-7c9f-4b7d-9969-0aac69d537aa"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:25.848033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0ec29e52-dca1-4df9-b60d-90e82ba89a9b req-c2586661-16b5-484a-922f-3496ecf59b32 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:25.849710 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0ec29e52-dca1-4df9-b60d-90e82ba89a9b req-c2586661-16b5-484a-922f-3496ecf59b32 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:25.883513 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-0ec29e52-dca1-4df9-b60d-90e82ba89a9b req-c2586661-16b5-484a-922f-3496ecf59b32 service nova] Creating event network-changed:074b3654-7c9f-4b7d-9969-0aac69d537aa for instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 on hv-cinder-84131 Jul 27 15:31:25.894614 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-0ec29e52-dca1-4df9-b60d-90e82ba89a9b req-c2586661-16b5-484a-922f-3496ecf59b32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076327 Jul 27 15:31:25.895944 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 210/432] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:31:26.009592 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:26.025826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-75e5e835-d107-4de5-86c2-dbfa7ab65192 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.440261 Jul 27 15:31:26.040542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 223/433] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:25 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:26.254218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:26.255395 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:26.269586 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:26.270152 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:26.270974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:26.271420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:26.473212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:26.480075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:26.485755 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:26.488089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:26.489450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-28d911ff-ccde-4a76-8db3-6e35cb601229 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.259918 Jul 27 15:31:26.499867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 211/434] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:26 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:26.727095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:26.728356 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:26.736066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:26.738137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:26.739601 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:26.741298 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:27.049514 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:27.050136 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:27.063908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:27.070902 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:27.073755 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:27.077653 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:27.078126 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:27.099502 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-224b94d4-1ac4-4b09-8086-06bbbfe56d86 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1313 microversion: 2.1 time: 0.375737 Jul 27 15:31:27.115295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 224/435] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:26 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:27.419776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:27.434612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a2e81e3f-a05b-4480-9740-046f9d53eb8f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.389554 Jul 27 15:31:27.435760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 212/436] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:27 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:27.518806 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:27.520003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:27.532000 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:27.533183 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:27.534533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:27.535173 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:27.717098 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:27.728780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:27.731642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:27.733093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8ff425a0-426e-4065-b8d5-b4da26b4f9fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.218250 Jul 27 15:31:27.734258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 225/437] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:27 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:28.133729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:28.134353 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:28.149361 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:28.151961 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:28.155970 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:28.158445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:28.448495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:28.461584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f8c9f6aa-9a5b-4e43-8e62-c9789a0fa0a1 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1497 microversion: 2.1 time: 0.332746 Jul 27 15:31:28.462886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 213/438] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:28 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1497 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:28.477634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:28.488936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:28.507459 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:28.508444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:28.509718 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:28.510386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:28.715467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:28.725375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d9b653fe-1d12-4c20-b561-de6676ab06f6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.267723 Jul 27 15:31:28.732338 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 226/439] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:28 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:28.760028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:28.761238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:28.775331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:28.776221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:28.782720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:28.783525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.052738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:29.066097 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:29.068285 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:29.069468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3fd1d558-e5f6-4677-b641-9636bcdc7987 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.314996 Jul 27 15:31:29.088539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 214/440] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:28 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:29.158696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:29.159448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:29.165877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:29.166512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.167472 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:29.168113 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.188408 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=100 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:29.204162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:31:29.336564 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a5415ce6-0021-42ae-9658-cb7e3b5a2555 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "DELETE /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 204 len: 0 microversion: 2.1 time: 0.179278 Jul 27 15:31:29.337673 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 227/441] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:31:29 2022] DELETE /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:31:29.347282 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:29.348689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:29.360253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:29.360725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.368880 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:29.369335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.556517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:29.565427 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e7ec9c39-acfc-4764-8725-e2f24f49293d tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1503 microversion: 2.1 time: 0.222660 Jul 27 15:31:29.568184 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 215/442] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:29 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:29.755500 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:29.759975 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:29.762810 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:29.763446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.764415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:29.765002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:29.964398 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:29.978277 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-00ad744b-ec23-418c-be75-b56be0de551f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.226970 Jul 27 15:31:29.983013 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 228/443] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:29 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:30.097692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:30.098748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:30.105918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:30.106375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:30.107183 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:30.107621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:30.296081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:30.307350 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:30.310033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:30.311281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c90455ad-3067-4467-918d-d0d9a01031d8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.220744 Jul 27 15:31:30.312113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 216/444] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:30 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:30.590116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:30.590866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:30.593077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:30.608980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:30.608980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:30.608980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:30.608980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:30.767626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:30.775726 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2add6eae-1650-475d-afbe-b12b70b8b298 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1503 microversion: 2.1 time: 0.189580 Jul 27 15:31:30.776345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 229/445] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:30 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:31.010415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:31.010415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:31.016196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:31.016646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:31.017437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:31.017893 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:31.172261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:31.181366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-73653434-3dad-408b-9c1d-5daa069f0275 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1724 microversion: 2.1 time: 0.177806 Jul 27 15:31:31.182290 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 217/446] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:31 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:31.335376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:31.336133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:31.342484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:31.343238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:31.344095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:31.344724 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:31.503584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:31.513300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:31.515382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:31.517135 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3c511818-8487-4fb6-bcc3-db5c20709041 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.185851 Jul 27 15:31:31.518391 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 230/447] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:31 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:31.798497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:31.799211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:31.805216 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:31.805669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:31.806457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:31.806856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:31.954936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:31.970151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b97b3e70-e1ac-4a22-a500-d2c06d140e4e tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1503 microversion: 2.1 time: 0.175324 Jul 27 15:31:31.971287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 218/448] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:31 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:32.203423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:32.204060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:32.210086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.210532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.211286 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.211719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.456469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:32.464593 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4c7fd421-af73-4c6a-a780-3f39d6270e8c tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1701 microversion: 2.1 time: 0.265065 Jul 27 15:31:32.465160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 231/449] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:32 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1701 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:32.486397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c84b4168-040e-490f-a7d7-d3d028f0b996 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:32.492585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c84b4168-040e-490f-a7d7-d3d028f0b996 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.493025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c84b4168-040e-490f-a7d7-d3d028f0b996 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.541488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:32.543364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:32.551385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.552240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.553503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.554092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.556184 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c84b4168-040e-490f-a7d7-d3d028f0b996 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Going to try to start instance {{(pid=117870) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 15:31:32.604571 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c84b4168-040e-490f-a7d7-d3d028f0b996 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action" status: 202 len: 0 microversion: 2.1 time: 0.121902 Jul 27 15:31:32.605252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 219/450] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:31:32 2022] POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:31:32.616693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:32.617429 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:32.625888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.626726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.627605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.628168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.815538 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:32.826488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:32.835197 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:32.837497 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:32.838469 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-74945a03-5b7a-4974-83ae-c8019be67d37 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1710 microversion: 2.1 time: 0.226631 Jul 27 15:31:32.839162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 220/451] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:32 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1710 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:32.839514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-55b67cb6-b6a6-4685-9e40-3392e9d82ac8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1739 microversion: 2.20 time: 0.301907 Jul 27 15:31:32.840227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 232/452] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:32 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:32.844378 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-3a3e6d6b-366d-446e-a12d-6397232f8a35 req-b6d946c0-f2dc-4af3-a915-f522583e0990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999cce74-ed7b-47f2-876e-4057dd968208", "name": "network-vif-deleted", "tag": "6a722c74-0274-458f-af51-1788f0f2a28c"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:32.855153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3a3e6d6b-366d-446e-a12d-6397232f8a35 req-b6d946c0-f2dc-4af3-a915-f522583e0990 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:32.855794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3a3e6d6b-366d-446e-a12d-6397232f8a35 req-b6d946c0-f2dc-4af3-a915-f522583e0990 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:32.869342 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-3a3e6d6b-366d-446e-a12d-6397232f8a35 req-b6d946c0-f2dc-4af3-a915-f522583e0990 service nova] Creating event network-vif-deleted:6a722c74-0274-458f-af51-1788f0f2a28c for instance 999cce74-ed7b-47f2-876e-4057dd968208 on hv-cinder-84131 Jul 27 15:31:32.874743 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-3a3e6d6b-366d-446e-a12d-6397232f8a35 req-b6d946c0-f2dc-4af3-a915-f522583e0990 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Jul 27 15:31:32.875905 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 221/453] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:31:32.990919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:32.991773 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:33.005002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.005447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:33.006211 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.006811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:33.042654 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.043105 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:33.043555 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lazy-loading 'fault' on Instance uuid 999cce74-ed7b-47f2-876e-4057dd968208 {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:31:33.118386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd41786cce9c4b8081f3a466140d268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8719c555ca834c738566a2cc7684e9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:33.126817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-df8bc0e3-52fc-41d9-aca6-9202520f8ad8 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 200 len: 1303 microversion: 2.1 time: 0.139435 Jul 27 15:31:33.127405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 233/454] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:32 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:33.866080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:33.869034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:33.874404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:33.876458 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:33.884739 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.885845 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:33.887818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.888823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:33.889644 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.890378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:33.891601 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:33.892386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:34.100780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:34.114209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:34.115869 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:34.117153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-67a707fd-83c4-4749-a3ce-e7bfbd5b86c3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1721 microversion: 2.20 time: 0.250968 Jul 27 15:31:34.117953 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 234/455] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:33 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:34.134052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:34.149909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9c2a3d33-baef-4e8d-8e7d-bb0f44dfae31 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1710 microversion: 2.1 time: 0.291909 Jul 27 15:31:34.151120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 222/456] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:33 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1710 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:34.155379 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:34.156196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] [instance: 999cce74-ed7b-47f2-876e-4057dd968208] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:34.163563 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:34.164152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:34.164999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:34.165503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:34.184485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] HTTP exception thrown: Instance 999cce74-ed7b-47f2-876e-4057dd968208 could not be found. Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Request method failure captured: Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 HTTP/1.1 Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VoXm-kgRIlFzAcGLFNYzYb-WWo2GNQFqyEJPswnLzgQrzK1v2YlRdmAEbbX46levgMlqZWiHBRtVMCOx_URzypQRUIPznH84KZZ57vRuKIMJSg8xZEUR_Q_SC3CTz0X7KXP92K8WSeEzf3NTs6oAGMvsRqNME8py6wwo8BEEwA89Nc Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 8719c555ca834c738566a2cc7684e9eb Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesActionsTest-205173318 Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:31:34.187296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8719c555ca834c738566a2cc7684e9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8719c555ca834c738566a2cc7684e9eb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8719c555ca834c738566a2cc7684e9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8719c555ca834c738566a2cc7684e9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesActionsTest-205173318 Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 8719c555ca834c738566a2cc7684e9eb Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesActionsTest-205173318 Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesActionsTest-205173318-project Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: cd41786cce9c4b8081f3a466140d268b Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesActionsTest-205173318-project Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 999cce74-ed7b-47f2-876e-4057dd968208 could not be found. Jul 27 15:31:34.190638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '999cce74-ed7b-47f2-876e-4057dd968208'} Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999cce74-ed7b-47f2-876e-4057dd968208 could not be found. Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:31:34.192387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999cce74-ed7b-47f2-876e-4057dd968208 could not be found. Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999cce74-ed7b-47f2-876e-4057dd968208 could not be found. Jul 27 15:31:34.194803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:31:34.196961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] Returning 404 to user: Instance 999cce74-ed7b-47f2-876e-4057dd968208 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:31:34.196961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3c46ff09-f62d-4814-ae97-e830e7437bb4 tempest-VolumesActionsTest-205173318 tempest-VolumesActionsTest-205173318-project] 10.222.0.36 "GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208" status: 404 len: 111 microversion: 2.1 time: 0.043921 Jul 27 15:31:34.196961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 235/457] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:34 2022] GET /compute/v2.1/servers/999cce74-ed7b-47f2-876e-4057dd968208 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:31:35.153693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:35.154805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:35.162220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:35.162667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:35.163466 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:35.163927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:35.182909 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:35.183524 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:35.189938 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:35.190392 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:35.191501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:35.192038 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:35.300747 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:35.309785 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:35.312581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:35.314964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c28f420c-86be-446f-a9af-59fa87cba699 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1721 microversion: 2.20 time: 0.164987 Jul 27 15:31:35.315535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 223/458] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:35 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:35.543667 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:35.551809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ddbd705d-fbf8-45a5-a5ab-864d7fefba8e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1710 microversion: 2.1 time: 0.372784 Jul 27 15:31:35.552394 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 236/459] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:35 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1710 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:31:36.338488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:36.339115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:36.346205 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:36.346652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:36.347425 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:36.347888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:36.518651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:36.526935 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:36.528476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:36.529637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-136e786c-b1f6-4156-ada6-6ac55aa800ea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1721 microversion: 2.20 time: 0.195117 Jul 27 15:31:36.530311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 224/460] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:36 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:36.574868 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:36.575468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:36.581971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:36.582414 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:36.583169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:36.583607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:36.716844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:36.725686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-881f04b5-8ef2-45e3-adff-3064c2d6c256 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1710 microversion: 2.1 time: 0.154504 Jul 27 15:31:36.726266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 237/461] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:36 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:37.552895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:37.553516 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:37.560200 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:37.560654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:37.561496 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:37.561933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:37.567422 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-a0ada80e-70a2-49a5-a009-493499a7e65f req-bb8c9772-8716-4a59-8a22-37648d4f52cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "name": "network-vif-unplugged", "status": "completed", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:37.578196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-a0ada80e-70a2-49a5-a009-493499a7e65f req-bb8c9772-8716-4a59-8a22-37648d4f52cd service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:37.578800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-a0ada80e-70a2-49a5-a009-493499a7e65f req-bb8c9772-8716-4a59-8a22-37648d4f52cd service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:37.591156 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-a0ada80e-70a2-49a5-a009-493499a7e65f req-bb8c9772-8716-4a59-8a22-37648d4f52cd service nova] Creating event network-vif-unplugged:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:31:37.597710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-a0ada80e-70a2-49a5-a009-493499a7e65f req-bb8c9772-8716-4a59-8a22-37648d4f52cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035179 Jul 27 15:31:37.599111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 238/462] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:31:37.705980 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:37.714344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:37.715896 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:37.717042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a5847e07-1462-4cb0-adda-59d0a8630716 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1721 microversion: 2.20 time: 0.168913 Jul 27 15:31:37.717599 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 225/463] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:37 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:37.748148 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:37.748860 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:37.755294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:37.755740 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:37.756526 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:37.756960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:37.892452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:37.900461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-111357ee-60f7-4138-94d4-e290e463fedb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1710 microversion: 2.1 time: 0.156569 Jul 27 15:31:37.901037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 239/464] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:37 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:38.741247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:38.741824 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:38.748017 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:38.748470 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:38.749227 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:38.749689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:38.877735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:38.886039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:38.887551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:38.888965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-74486c12-299d-48dc-8dc7-c175ed80bfc0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1721 microversion: 2.20 time: 0.151741 Jul 27 15:31:38.904548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 226/465] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:38 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:38.923446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:38.924325 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:38.935675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:38.936163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:38.936940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:38.937378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:39.082545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:39.091645 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3e7ff6d5-7b22-4bb9-8a5d-81fe94fcd909 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1710 microversion: 2.1 time: 0.172929 Jul 27 15:31:39.092680 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 240/466] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:38 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:39.912278 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:39.913071 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:39.922775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:39.923327 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:39.924113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:39.924542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.112541 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:40.114765 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:40.115455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:40.122675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.123380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.124412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.125213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.141196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:40.142804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:40.144254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a4eb8658-2362-4193-b425-84692e82e22a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1724 microversion: 2.20 time: 0.235707 Jul 27 15:31:40.144806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 227/467] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:39 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:31:40.172152 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff183e5f-68bb-45a2-9b50-9275c11465b6"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:40.175252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:40.195914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.196634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.197593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.198178 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.216827 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:40.304327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:40.312754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a0e3d611-6930-4f44-9333-d87c43f42bed tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1714 microversion: 2.1 time: 0.202653 Jul 27 15:31:40.313375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 241/468] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:31:40 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:31:40.531087 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6287a27f-7983-42bd-93c9-8d936524faac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362720 Jul 27 15:31:40.531925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 228/469] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Jul 27 15:31:40 2022] POST /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:31:40.677278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:31:40.678043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:40.684635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.685173 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.686011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.686513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.734635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117869) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 15:31:40.774417 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:40.814033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ebf941bd-4c62-4e82-8e10-16077cc34c20 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/action" status: 202 len: 0 microversion: 2.20 time: 0.141386 Jul 27 15:31:40.814651 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 242/470] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Jul 27 15:31:40 2022] POST /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:31:40.829324 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:40.830399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:40.838990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.839538 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:40.840336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:40.840819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:41.002420 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:41.011588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:41.013254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:41.014790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4c1031b3-6804-4330-9b88-48778350b5eb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1810 microversion: 2.20 time: 0.194967 Jul 27 15:31:41.015900 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 229/471] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:40 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:42.055287 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:42.055960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:42.062807 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:42.063747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:42.064807 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:42.065238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:42.203542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:42.214047 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:42.215857 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:42.217053 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-923d046f-b750-40a1-9fa4-5b8da181006d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1750 microversion: 2.20 time: 0.166406 Jul 27 15:31:42.217665 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 243/472] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:42 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:43.240582 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:43.241115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:43.247940 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:43.248390 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:43.249158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:43.249598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:43.409801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:43.418513 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:43.420056 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:43.421213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-645fe420-8d84-426e-b569-027cea722a0f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1750 microversion: 2.20 time: 0.184632 Jul 27 15:31:43.421764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 230/473] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:43 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:44.445232 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:44.445855 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:44.451881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:44.452332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:44.453165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:44.453766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:44.615950 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:44.625199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:44.627289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:44.628512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e4a6125a-2c05-4244-8299-7fde352fd8ff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1750 microversion: 2.20 time: 0.187721 Jul 27 15:31:44.644262 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 244/474] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:44 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:45.650867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:45.651818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:45.660514 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:45.661399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:45.662288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:45.662948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:45.843251 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:45.852503 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:45.854403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:45.855880 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-90d7f5f4-492b-411b-af05-caf818286ae3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1750 microversion: 2.20 time: 0.208892 Jul 27 15:31:45.857543 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 231/475] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:45 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:46.883227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:46.883994 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:46.890854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:46.892200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:46.893114 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:46.893591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:47.041144 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:47.057351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:47.059136 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:47.060992 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7c1d442e-630f-459d-865a-36f8b5f75758 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1750 microversion: 2.20 time: 0.181796 Jul 27 15:31:47.062016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 245/476] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:46 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:48.100826 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:48.101432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:48.111445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:48.112414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:48.113441 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:48.114098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:48.291059 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:48.300689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:48.302439 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:48.303784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2fee48af-a7c3-4dd3-bc98-5501628bb343 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1750 microversion: 2.20 time: 0.206868 Jul 27 15:31:48.304663 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 232/477] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:48 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:49.335134 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:49.336876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:49.352334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:49.353132 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:49.356219 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:49.357803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:49.560231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:49.570754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:49.572716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:49.574176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3d812053-190a-438e-a3cc-0368151fe9d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1752 microversion: 2.20 time: 0.244985 Jul 27 15:31:49.574902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 246/478] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:49 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:50.604054 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:50.605373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:50.614995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:50.616123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:50.617646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:50.618274 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:50.783183 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:50.812271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:50.822319 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:50.824692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b531ce8f-daf8-4e82-b596-14098be6f0f7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.226469 Jul 27 15:31:50.829968 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 233/479] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:50 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:51.859044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:51.861260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:51.879126 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:51.879873 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:51.880968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:51.882166 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:52.056305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:52.067604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:52.069668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:52.071328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2b4e5b77-5a92-40d3-8520-32bc2434d734 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.216192 Jul 27 15:31:52.072443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 247/480] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:51 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:53.097520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:53.098204 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:53.113862 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=58 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:53.119325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:53.119325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:53.119325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:53.119325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:53.293573 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:53.303008 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:53.306043 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:53.307500 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c9ce0467-f467-497a-8277-5db9e7cda063 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.214998 Jul 27 15:31:53.308381 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 234/481] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:53 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:54.338260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:54.341393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:54.364083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:54.364655 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:54.365491 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:54.365935 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:54.571606 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:54.581217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:54.583480 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:54.585510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f57904e9-c182-48e1-8090-20d7bc0b6411 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.254112 Jul 27 15:31:54.595879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 248/482] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:54 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:55.610183 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:55.610813 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:55.625086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:55.625648 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:55.636762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:55.637212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:55.912524 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:55.929236 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:55.933675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:55.934974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eec9c202-1457-47a7-9cb5-5e1544af9d4f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.329418 Jul 27 15:31:55.947900 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 235/483] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:55 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:56.970863 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:56.971473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:56.978615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:56.979667 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:56.980730 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:56.981370 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:57.230310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:57.240320 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:57.243331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:57.244789 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-edcb1b0a-c397-428a-9c4c-e01674236918 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.282298 Jul 27 15:31:57.261432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 249/484] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:56 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:58.270098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:58.270731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:58.283121 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:58.283604 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:58.285164 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:58.285990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:58.597142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:58.615535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:58.615535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:58.615535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-04c93b90-11e6-4654-a984-1ddc8d455711 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.346468 Jul 27 15:31:58.623556 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 236/485] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:58 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:31:59.639689 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:31:59.643766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:31:59.658558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:59.660452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:59.662248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:31:59.665160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:31:59.948609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:59.962346 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:59.964228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:31:59.967447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f1424699-7610-40f2-9d4b-ada4ca1ee56c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.334598 Jul 27 15:31:59.983858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 250/486] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:31:59 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:00.992200 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:00.992915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:00.999646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:01.000151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:01.000976 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:01.001414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:01.143708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:01.152122 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:01.153639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:01.154789 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fd5f62b9-69ff-461c-9dff-3a21d70dd117 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.166652 Jul 27 15:32:01.155477 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 237/487] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:00 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:02.179818 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:02.180874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:02.182960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:02.188652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:02.189102 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:02.189877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:02.190311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:02.338918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:02.347591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:02.349231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:02.350396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b4252152-36ec-4727-a848-184cc93cfc41 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.175099 Jul 27 15:32:02.350922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 251/488] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:02 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:03.372872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:03.373549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:03.380078 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:03.380533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:03.381297 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:03.381735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:03.513474 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:03.522249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:03.523730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:03.524903 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-77db0fc3-aa3d-4c2d-b3f7-b9c97fd8c3fc tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.155942 Jul 27 15:32:03.525457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 238/489] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:03 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:32:04.550803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:04.551637 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:04.557745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:04.558263 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:04.559096 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:04.559622 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:04.725641 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:04.735552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:04.737172 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:04.738386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ec0718d6-77c4-4a6a-9274-262f108fd2fd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.193047 Jul 27 15:32:04.739007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 252/490] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:04 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:05.764818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:05.765874 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:05.772421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:05.772867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:05.773626 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:05.774059 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:05.911630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:05.920237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:05.921734 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:05.922904 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-80520868-789c-4410-9016-f37e3eb6571f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.162011 Jul 27 15:32:05.923761 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 239/491] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:05 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:06.946816 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:06.947529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:06.954089 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:06.954632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:06.955421 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:06.955931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:07.123036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:07.133273 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:07.134753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:07.136124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0a713ade-4205-42e3-a669-5bdf17ff9318 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.193588 Jul 27 15:32:07.136671 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 253/492] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:06 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:08.161208 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:08.161969 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:08.168309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:08.169069 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:08.169926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:08.170574 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:08.311982 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:08.321542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:08.323366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:08.324823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6f71c9aa-6328-44b4-b3bb-d0bc161bd9a2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.168275 Jul 27 15:32:08.325550 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 240/493] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:08 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:09.349196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:09.349794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:09.358240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:09.359578 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:09.360062 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:09.360488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:09.539339 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:09.549306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:09.550805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:09.552182 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-efab0e2e-0e64-4196-a0c3-9110b4aef0bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.206806 Jul 27 15:32:09.552748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 254/494] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:09 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:32:10.193222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-755586782", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "networks": [{"uuid": "06d35727-8629-40ca-8166-04dcfe2f8e49"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:10.248227 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] validate_networks() for [('06d35727-8629-40ca-8166-04dcfe2f8e49', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:32:10.575803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:10.576643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:10.583138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:10.584499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:10.584499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:10.586181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:10.674462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:32:10.674996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:32:10.675822 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:32:10.676299 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:32:10.677341 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:32:10.688670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:10.689133 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:10.689946 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:10.690658 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:10.697877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:10.713054 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Getting quotas for project 465f32cb4f724c18aad10fca114a1321. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:32:10.717554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Getting quotas for user d040957e3ea04505bfa9e3b3d7c66f52 and project 465f32cb4f724c18aad10fca114a1321. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:32:10.728763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:32:10.730953 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:10.731174 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:32:10.740190 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:10.741682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:10.742850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fb46b30a-76bf-41dd-8424-669f039afa8b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.171198 Jul 27 15:32:10.743717 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 255/495] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:10 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:32:10.783464 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d01b03c8-02c3-476c-8e23-dd24bec9add9 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594263 Jul 27 15:32:10.784166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 241/496] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:32:10.796154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b8e6386f-dc06-40d1-97af-77ca8e794012 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:10.797000 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b8e6386f-dc06-40d1-97af-77ca8e794012 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:10.855565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b8e6386f-dc06-40d1-97af-77ca8e794012 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:10.866204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b8e6386f-dc06-40d1-97af-77ca8e794012 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1218 microversion: 2.1 time: 0.074409 Jul 27 15:32:10.866204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 256/497] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:10 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:11.769915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:11.770539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:11.777433 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:11.777877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:11.778632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:11.779066 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:11.888832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:11.889443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:11.897435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:11.898494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:11.899729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:11.900205 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:11.906230 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:11.924891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:11.934188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:11.935807 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:11.937774 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fef2751b-25e1-4416-8f8e-5b138b0e1c7e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.172112 Jul 27 15:32:11.956940 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 242/498] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:11 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:12.019057 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:12.035620 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-22782aef-349c-40df-81c2-a3adad3ca652 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1278 microversion: 2.1 time: 0.151300 Jul 27 15:32:12.036910 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 257/499] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:11 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:12.965733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:12.966957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:12.974145 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:12.974589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:12.975355 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:12.975789 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:13.062427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:13.064907 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:13.076700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:13.077696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:13.081323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:13.082819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:13.130058 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:13.139154 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:13.140670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:13.142944 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-496fc52d-6bbf-42e5-8329-1eddccdb6947 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.181288 Jul 27 15:32:13.143863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 243/500] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:12 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:13.195229 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-0601eefd-3c93-48d6-b586-f56b6f7270da req-7561c513-22a2-458a-acd3-0d09e8ce0c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "name": "network-vif-plugged", "status": "completed", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:13.206239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0601eefd-3c93-48d6-b586-f56b6f7270da req-7561c513-22a2-458a-acd3-0d09e8ce0c3c service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:13.207165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0601eefd-3c93-48d6-b586-f56b6f7270da req-7561c513-22a2-458a-acd3-0d09e8ce0c3c service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:13.225434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-0601eefd-3c93-48d6-b586-f56b6f7270da req-7561c513-22a2-458a-acd3-0d09e8ce0c3c service nova] Creating event network-vif-plugged:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:32:13.230665 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-0601eefd-3c93-48d6-b586-f56b6f7270da req-7561c513-22a2-458a-acd3-0d09e8ce0c3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042542 Jul 27 15:32:13.231374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 244/501] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:13.289903 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:13.298240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-42e88a8e-0a89-4789-addb-c5a9e8f25a67 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.244727 Jul 27 15:32:13.299164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 258/502] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:13 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:13.422005 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-25ad3441-c5c5-4b8c-8914-dfe467ed72ac req-41dddd18-abae-4a00-b028-1c195439911e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b030b650-ce61-4238-821f-51cc611f0e67", "tag": "e7fab7d2-df99-4add-a73d-c71c9a71af46"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:13.433779 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-25ad3441-c5c5-4b8c-8914-dfe467ed72ac req-41dddd18-abae-4a00-b028-1c195439911e service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:13.434213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-25ad3441-c5c5-4b8c-8914-dfe467ed72ac req-41dddd18-abae-4a00-b028-1c195439911e service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:13.448235 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-25ad3441-c5c5-4b8c-8914-dfe467ed72ac req-41dddd18-abae-4a00-b028-1c195439911e service nova] Creating event network-changed:e7fab7d2-df99-4add-a73d-c71c9a71af46 for instance b030b650-ce61-4238-821f-51cc611f0e67 on hv-cinder-84131 Jul 27 15:32:13.452274 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-25ad3441-c5c5-4b8c-8914-dfe467ed72ac req-41dddd18-abae-4a00-b028-1c195439911e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034363 Jul 27 15:32:13.452854 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 245/503] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:14.166293 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:14.166927 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:14.173407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:14.173847 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:14.174596 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:14.175025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:14.320168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:14.320868 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:14.327481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:14.327959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:14.329513 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:14.330029 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:14.331341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:14.339818 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:14.341335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:14.342479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c99e2587-7582-40a2-b165-ee731d06f35a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.180101 Jul 27 15:32:14.343033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 259/504] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:14 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:14.471600 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:14.479177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fc790795-5d0a-4004-b46c-b759df3fe15c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.163877 Jul 27 15:32:14.479738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 246/505] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:14 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:15.366430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:15.367018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:15.373062 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:15.373505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:15.374298 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:15.374719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:15.500585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:15.501317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:15.509116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:15.510014 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:15.510344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:15.510782 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:15.521238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:15.530405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:15.532114 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:15.533401 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f00ca3ca-dbd7-493f-84c7-0cd763038873 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.170857 Jul 27 15:32:15.534034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 260/506] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:15 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:15.657148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:15.665071 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b337b06d-cc18-4bd6-b448-69f3e2e7139e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.168445 Jul 27 15:32:15.665658 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 247/507] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:15 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:16.557280 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:16.558506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:16.564803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:16.565599 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:16.566476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:16.566911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:16.686388 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:16.686993 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:16.693800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:16.694240 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:16.695002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:16.695430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:16.707279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:16.716138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:16.717620 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:16.718774 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dc31d28f-98b3-4432-9236-edb9bec97a1d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1808 microversion: 2.20 time: 0.165453 Jul 27 15:32:16.719499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 261/508] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:16 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:32:16.842987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:16.851593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3069ba3e-10bc-4cf3-bffc-a0b8e77de166 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.169021 Jul 27 15:32:16.852225 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 248/509] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:16 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:17.743414 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:17.744075 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:17.752849 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:17.753373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:17.754198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:17.756522 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:17.873016 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:17.873661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:17.881047 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:17.881498 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:17.882275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:17.882715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:17.892798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:17.902356 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:17.903881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:17.905076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3a3cc948-f8e2-43af-929a-9e6c4b9d5242 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1795 microversion: 2.20 time: 0.165771 Jul 27 15:32:17.905638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 262/510] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:32:17 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1795 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:32:18.023547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:18.031414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6e4d19f0-deb2-4cb9-bcec-c5b9f70c5a1a tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.162190 Jul 27 15:32:18.032056 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 249/511] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:17 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:19.052863 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:19.053499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:19.059686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:19.060140 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:19.061032 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:19.061465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:19.221171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:19.224932 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b86820f7-afa5-4fa4-b72b-20583bce80ce req-923e3c0e-799c-49a2-a134-ecd3006fa05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b030b650-ce61-4238-821f-51cc611f0e67", "name": "network-vif-plugged", "status": "completed", "tag": "e7fab7d2-df99-4add-a73d-c71c9a71af46"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:19.235423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d3042be4-ff11-46ff-ac10-09fe7c21d027 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.185649 Jul 27 15:32:19.236237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b86820f7-afa5-4fa4-b72b-20583bce80ce req-923e3c0e-799c-49a2-a134-ecd3006fa05e service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:19.236913 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 263/512] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:19 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:19.237086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b86820f7-afa5-4fa4-b72b-20583bce80ce req-923e3c0e-799c-49a2-a134-ecd3006fa05e service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:19.267915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-b86820f7-afa5-4fa4-b72b-20583bce80ce req-923e3c0e-799c-49a2-a134-ecd3006fa05e service nova] Creating event network-vif-plugged:e7fab7d2-df99-4add-a73d-c71c9a71af46 for instance b030b650-ce61-4238-821f-51cc611f0e67 on hv-cinder-84131 Jul 27 15:32:19.273336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b86820f7-afa5-4fa4-b72b-20583bce80ce req-923e3c0e-799c-49a2-a134-ecd3006fa05e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052206 Jul 27 15:32:19.274154 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 250/513] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:32:20.266461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:20.267544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:20.277739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:20.278193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:20.279087 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:20.279586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:20.431410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:20.440384 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5e9aa3d3-53cd-45fe-8afc-a2776f2c6249 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1318 microversion: 2.1 time: 0.177613 Jul 27 15:32:20.440986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 264/514] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:20 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:21.471117 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:21.471853 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:21.474336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:21.475002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:21.480380 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:21.480833 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:21.481593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:21.482025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:21.618074 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:21.627092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a4b75e21-3b04-48fc-b2bb-eec8c3956ac7 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1506 microversion: 2.1 time: 0.162896 Jul 27 15:32:21.627869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 251/515] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:21 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:23.319052 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b304f89-9eab-4344-9cdc-1dd964448207"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:23.321423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:23.323296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:23.330341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:23.330788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:23.331737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:23.332362 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:23.652231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-edc09dc8-3bb5-46ea-8312-8c9d4ba567ab tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337086 Jul 27 15:32:23.652973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 265/516] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:32:23 2022] POST /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:31.264416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:31.266722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:31.270447 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:31.280239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:31.280823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:31.281746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:31.282432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:31.309855 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lazy-loading 'flavor' on Instance uuid 77a2ca90-8534-41a1-b3e4-4a02f4deba86 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:32:31.457149 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fb8c7d28-7f2b-467a-98b8-f47df3d8a03a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/action" status: 200 len: 32 microversion: 2.1 time: 0.196117 Jul 27 15:32:31.457887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 252/517] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:32:31 2022] POST /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:32:31.470417 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:31.472033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:31.479763 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:31.480221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:31.480995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:31.481430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:31.944059 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:31.953099 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-17779f34-e0f9-45d6-9948-12cfbbfaf857 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.489067 Jul 27 15:32:31.953879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 266/518] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:31 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:32.976165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:32.976826 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:32.984215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:32.984675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:32.985576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:32.986115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:33.127520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:33.136114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0b9af715-0c01-4fbd-8310-5a15cad3e3f7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.165271 Jul 27 15:32:33.136703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 253/519] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:32 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:34.158304 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:34.159636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:34.162947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=34 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:34.169050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:34.169496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:34.170261 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:34.170755 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:34.322372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:34.332318 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fecb9f97-865a-4fc3-8ca6-5d62a06c6010 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.178460 Jul 27 15:32:34.333019 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 267/520] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:34 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:35.358445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:35.359035 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:35.366132 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:35.366575 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:35.367339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:35.367770 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:35.507048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:35.517637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1a1a633e-b070-4b68-aed4-023a4c78e92a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.162864 Jul 27 15:32:35.519063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 254/521] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:35 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:36.540981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:36.541543 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:36.548152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:36.548596 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:36.549863 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:36.550293 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:36.683479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:36.691768 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-00cb181c-85f7-47b3-969d-c79a49b61127 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.154688 Jul 27 15:32:36.692370 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 268/522] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:36 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:37.714572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:37.715226 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:37.721928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:37.722383 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:37.723155 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:37.723592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:37.879092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:37.887841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a56b6948-10b5-4b05-8a03-fcf645312ed9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.178236 Jul 27 15:32:37.888434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 255/523] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:37 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:38.910709 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:38.911378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:38.918949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:38.919392 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:38.920196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:38.920620 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:39.082103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:39.090793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-81318784-b6e2-420f-a535-b86bd3518675 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.184523 Jul 27 15:32:39.091371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 269/524] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:38 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:39.765869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:39.766537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:39.772417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:39.772862 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:39.773612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:39.774051 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:39.905695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lazy-loading 'services' on Instance uuid ba023b6d-f35a-4213-979f-652a4c79acd9 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:32:40.029882 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3cfb53b9-3ce0-4c91-b661-ac50d26f3f56 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-volume_attachments/55131777-5fbf-4618-be33-361f2b1b9a07" status: 202 len: 0 microversion: 2.1 time: 0.267686 Jul 27 15:32:40.032631 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 256/525] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:32:39 2022] DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-volume_attachments/55131777-5fbf-4618-be33-361f2b1b9a07 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:32:40.089803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d6669f5-75ac-4f1d-b00a-2825a437d0bc", "device": "/dev/sdb"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:40.095209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:40.101752 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:40.102193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:40.103003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:40.103455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:40.114845 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:40.115535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:40.122084 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:40.122520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:40.123300 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:40.123735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:40.295925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:40.298232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:40.308376 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c48fc67d-78e1-4175-b186-31953b31ad86 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.197470 Jul 27 15:32:40.309683 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 257/526] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:40 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:40.402659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ef6c6da2-a922-433d-800d-299c15a6dcfa tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "POST /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317072 Jul 27 15:32:40.403175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 270/527] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:32:40 2022] POST /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:41.170225 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-36413546-fad4-40e6-a09b-56b39c794bb1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:41.181377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-36413546-fad4-40e6-a09b-56b39c794bb1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:41.182062 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-36413546-fad4-40e6-a09b-56b39c794bb1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:41.217522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-36413546-fad4-40e6-a09b-56b39c794bb1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Going to try to stop instance {{(pid=117870) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 15:32:41.278784 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-36413546-fad4-40e6-a09b-56b39c794bb1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action" status: 202 len: 0 microversion: 2.1 time: 0.114583 Jul 27 15:32:41.279414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 258/528] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:32:41 2022] POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:32:41.289582 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:41.290507 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:41.297028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:41.297646 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:41.298483 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:41.299715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:41.303215 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:41.333167 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:41.334075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:41.343584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:41.343584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:41.344725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:41.346506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:41.455485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:41.464118 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3b8eb923-4cd6-4b67-94be-345cf6d83a71 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.179074 Jul 27 15:32:41.464692 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 271/529] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:41 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:41.521644 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:41.535328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-42563642-bc8e-49ed-9ed4-4e94346fac56 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.207200 Jul 27 15:32:41.539937 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 259/530] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:41 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:42.487249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:42.488394 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:42.497875 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:42.498334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:42.499118 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:42.499557 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:42.561843 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:42.562564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:42.571764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:42.572312 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:42.573328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:42.573879 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:42.639638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:42.648929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4af06dc4-1939-4417-acdd-ac07ef19fdc9 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.165814 Jul 27 15:32:42.649615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 272/531] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:42 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:42.732098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:42.740728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-74f93cc6-7f07-4049-a438-b2d4ee27f22d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.183820 Jul 27 15:32:42.741658 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 260/532] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:42 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:43.671134 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:43.671742 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:43.679222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:43.679664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:43.680467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:43.680906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:43.764329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:43.765079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:43.773629 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:43.774310 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:43.775533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:43.776057 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:43.850406 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:43.858839 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2371d5a4-e0ba-431b-b2ea-4e423e1caba0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.191486 Jul 27 15:32:43.859615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 273/533] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:43 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:43.929510 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:43.938575 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4b7f92f4-28c4-47ce-ac0b-c21c7e1c5cde tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.179466 Jul 27 15:32:43.939221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 261/534] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:43 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:44.883720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:44.884374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:44.894742 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:44.895410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:44.896614 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:44.897269 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:44.961219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:44.961827 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:44.968723 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:44.969174 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:44.969954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:44.970386 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:45.039511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:45.047021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-08e4ed52-953b-4fd1-987c-8801476d5d24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.167109 Jul 27 15:32:45.047603 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 274/535] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:44 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:45.107382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:45.115522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-86c11832-f138-4381-9c39-f3f95a48df40 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.158166 Jul 27 15:32:45.116123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 262/536] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:44 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:46.070389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:46.071008 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:46.078118 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:46.078569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:46.079343 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:46.079809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:46.138322 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:46.139371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:46.148929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:46.149389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:46.150174 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:46.150621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:46.239108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:46.247219 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7eeee5a3-70a9-46c1-a821-1832473f2f0a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.181147 Jul 27 15:32:46.247798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 275/537] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:46 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:46.291029 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:46.299764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-668cdedf-f249-451b-b3b9-c3279ef0ca6a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.166272 Jul 27 15:32:46.300377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 263/538] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:46 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:47.270454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:47.271001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:47.277708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:47.278156 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:47.278929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:47.279364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:47.322933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:47.324863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:47.334309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:47.334928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:47.336050 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:47.336763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:47.418296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:47.427632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-32a99c14-404f-4e4f-afda-15a7a23bfa54 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.161566 Jul 27 15:32:47.428906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 276/539] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:47 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:47.485954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:47.494337 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cdcf23ca-4095-4b64-aac7-54d512826f21 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.176467 Jul 27 15:32:47.495038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 264/540] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:47 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:48.455606 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:48.456858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:48.463018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:48.463469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:48.464264 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:48.464697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:48.516464 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:48.517050 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:48.524857 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:48.525292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:48.526049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:48.526481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:48.603475 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:48.611173 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-61a4a674-5744-4c1e-9037-6cc0523d86a6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.160236 Jul 27 15:32:48.611757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 277/541] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:48 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:48.663106 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:48.671108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ea49f9b7-e409-429f-9cc2-f9f0c87cd56c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.158616 Jul 27 15:32:48.671667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 265/542] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:48 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:49.633819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:49.634424 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:49.640936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:49.641376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:49.642127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:49.642553 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:49.692969 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:49.693577 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:49.700139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:49.700592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:49.701360 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:49.701800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:49.778514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:49.787162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-218f3f0f-df04-4ef3-a5b8-97f58cc5d64e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.157157 Jul 27 15:32:49.787736 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 278/543] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:49 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:49.836724 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:49.844615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b0879f2c-d3ec-4406-9a2d-5494a2cd95cc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.156041 Jul 27 15:32:49.845270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 266/544] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:49 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:50.808415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:50.808946 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:50.816754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:50.817201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:50.818013 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:50.818452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:50.867198 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:50.867821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:50.874499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:50.874949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:50.875755 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:50.876224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:50.958844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:50.970739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-857c6283-4247-4334-9760-82c9e09cff29 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1678 microversion: 2.1 time: 0.166321 Jul 27 15:32:50.971335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 279/545] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:50 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:51.012632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:51.020709 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1e183ac4-4095-4ebd-b2d0-fe32ff648234 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.157495 Jul 27 15:32:51.021282 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 267/546] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:50 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:51.992527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:51.993138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:51.999506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:51.999999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.000764 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:52.001202 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.042324 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:52.043632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:52.050875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:52.051404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.052200 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:52.052630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.138015 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:52.145915 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0e53e283-67d4-47c6-a3c3-65cb583d4e3d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1655 microversion: 2.1 time: 0.157146 Jul 27 15:32:52.146496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 280/547] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:51 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:52.167362 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dbb9409f-66a7-4734-b4a9-c1c75ea02d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:52.174296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbb9409f-66a7-4734-b4a9-c1c75ea02d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:52.175356 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbb9409f-66a7-4734-b4a9-c1c75ea02d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.190285 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:52.198787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-488e5451-3407-41fe-9286-ac07f08cd390 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.160365 Jul 27 15:32:52.199450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 268/548] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:52 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:52.202748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dbb9409f-66a7-4734-b4a9-c1c75ea02d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Going to try to start instance {{(pid=117869) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 15:32:52.245213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dbb9409f-66a7-4734-b4a9-c1c75ea02d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action" status: 202 len: 0 microversion: 2.1 time: 0.081650 Jul 27 15:32:52.245823 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 281/549] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:32:52 2022] POST /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:32:52.261616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:52.262237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:52.268408 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:52.268859 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.269633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:52.270069 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:52.662806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:52.670472 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b92269fd-fdb2-4869-bf9b-5dc95748bf91 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.412602 Jul 27 15:32:52.671092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 269/550] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:52 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:53.221361 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:53.222063 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:53.228283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:53.228733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:53.229523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:53.229960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:53.361476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:53.369517 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-84e8c346-c8c0-4f3a-a5f4-bf0512d3fc1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.152772 Jul 27 15:32:53.370086 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 282/551] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:53 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:53.694502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:53.695130 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:53.701259 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:53.701736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:53.702491 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:53.702923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:53.832770 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:53.840332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7bdd590a-7329-4c28-8a30-312eea51688b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.150214 Jul 27 15:32:53.840906 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 270/552] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:53 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:54.391128 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:54.392260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:54.398825 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:54.399268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:54.400077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:54.400510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:54.531542 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:54.540074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1828262d-f3e7-47ab-bb5f-2fa23c974e1f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.153222 Jul 27 15:32:54.540639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 283/553] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:54 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:54.862919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:54.863653 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:54.870106 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:54.870547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:54.871303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:54.871727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:55.016115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:55.024182 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-57721e24-349d-4f67-802a-4de293abccec tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.165171 Jul 27 15:32:55.024753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 271/554] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:54 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:55.561221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:55.561832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:55.568738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:55.569182 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:55.569937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:55.570382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:55.701915 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:55.710077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bcda9fda-7d49-4fac-bcd8-82f7703256c2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1735 microversion: 2.1 time: 0.152705 Jul 27 15:32:55.710643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 284/555] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:55 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:56.046808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:56.047398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:56.055394 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:56.056108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:56.057328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:56.057984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:56.190943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:56.198585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2c77af90-40a0-4cef-b3f7-3037fc6eebab tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.156388 Jul 27 15:32:56.199148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 272/556] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:56 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:56.731528 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:56.732184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:56.738997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:56.739454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:56.740274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:56.740718 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:56.883162 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:56.891392 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-42ed7153-fe68-467f-8984-e9261704a769 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1715 microversion: 2.1 time: 0.163668 Jul 27 15:32:56.892749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 285/557] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:56 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:57.016329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:57.017478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:57.023485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.023978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.024732 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.025166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.039598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:57.107415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] HTTP exception thrown: Cannot 'detach_volume' instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 while it is in vm_state rescued Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Request method failure captured: Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments/9b304f89-9eab-4344-9cdc-1dd964448207 HTTP/1.1 Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4Vmj2-Uq8N8Yexb4Xf21A8zhJi8OiiyAEh7fjMMvt05Sacnem1jbCU-7l3M9nKZ7rX5cwMHn3bBOutSk62C9Ol5QQtWZIgV98Nq7UsHiDr4JmvyYSZrYEMEoTI80yaowyGAxb05l0HUSBpB4iXN4Hwy3pc2gDVyES2r9qHll9iS_nCA Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:32:57.109045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_736d8803a13e4dddb1ef32b7ab11eb1c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 51657a0e4865469999bdf8cd5102dad1 Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:32:57.110611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Cannot 'detach_volume' instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 while it is in vm_state rescued Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'server_id': '77a2ca90-8534-41a1-b3e4-4a02f4deba86', 'id': '9b304f89-9eab-4344-9cdc-1dd964448207'} Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:32:57.111374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 while it is in vm_state rescued Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 while it is in vm_state rescued Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:32:57.113042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Returning 409 to user: Cannot 'detach_volume' instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 while it is in vm_state rescued {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:32:57.114175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e5200532-eca5-4f9a-abb3-b9154045adf0 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments/9b304f89-9eab-4344-9cdc-1dd964448207" status: 409 len: 152 microversion: 2.1 time: 0.098198 Jul 27 15:32:57.114175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 273/558] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:32:57 2022] DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments/9b304f89-9eab-4344-9cdc-1dd964448207 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 15:32:57.119372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:57.119937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:57.125823 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.126773 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.127539 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.128000 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.160363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:57.208009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-066ccb17-2a08-4783-ad6a-7d8d65f14c71 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "POST /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/action" status: 202 len: 0 microversion: 2.1 time: 0.092191 Jul 27 15:32:57.208677 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 286/559] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:32:57 2022] POST /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:32:57.216962 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:57.217569 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:57.220178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:57.220892 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:57.223804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.224289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.225287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.225726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.227645 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.228127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.228927 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:57.229368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:57.372308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:57.373540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:57.380958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fdb0d9e6-7758-45e8-b2f2-92fe61320653 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.165000 Jul 27 15:32:57.381538 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 287/560] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:57 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:57.382377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c3e3a634-055a-4047-8dac-e4ec3911f76c tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1723 microversion: 2.1 time: 0.169207 Jul 27 15:32:57.383119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 274/561] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:57 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:58.402880 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:58.403483 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:58.403805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:58.404511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:58.410955 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:58.411405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:58.412039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:58.412216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:58.412643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:58.412793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:58.413413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:58.413845 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:58.549469 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:58.553494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:58.558158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b1de9dbe-d47e-4332-8da0-bf789e11154d tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1723 microversion: 2.1 time: 0.158271 Jul 27 15:32:58.559118 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 275/562] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:58 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:58.561066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-03bd561c-14f1-4cd7-8c27-1ad23d50bfb6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.161992 Jul 27 15:32:58.561626 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 288/563] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:58 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:59.581737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:59.582412 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:59.582863 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:59.583476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:32:59.589146 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:59.589605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:59.590222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:59.590668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:59.590964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:59.591432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:32:59.591919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:59.592095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:32:59.747597 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:59.750769 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:59.756917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5618cdb1-c60a-4ff2-9b70-24661ffd9207 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1723 microversion: 2.1 time: 0.179841 Jul 27 15:32:59.757501 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 276/564] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:59 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:59.760012 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0b743574-f64a-4397-84aa-56909052e9e1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1664 microversion: 2.1 time: 0.181493 Jul 27 15:32:59.760858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 289/565] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:32:59 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1664 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:00.782736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:00.783406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:00.788936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:00.789548 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:00.790412 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:00.790852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:00.791633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:00.792172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:00.796644 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:00.797103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:00.798437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:00.799079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:00.941391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:00.944550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:00.949373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7c777e77-47b1-45c3-b064-0b71b9d3e421 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1668 microversion: 2.1 time: 0.171005 Jul 27 15:33:00.949952 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 277/566] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:00 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:00.958440 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5e242a26-8833-4dbd-9506-3677861776f4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1723 microversion: 2.1 time: 0.173360 Jul 27 15:33:00.959870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 290/567] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:00 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:01.980790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:01.981391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:01.983634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=52 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:01.989640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:01.990083 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:01.990834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:01.991263 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:02.123370 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:02.131943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f80689fe-a105-4967-a001-aad93d9ed723 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1723 microversion: 2.1 time: 0.155059 Jul 27 15:33:02.132515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 278/568] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:01 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:03.152944 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:03.153814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:03.160949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:03.161478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:03.162198 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:03.162681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:03.311015 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:03.321169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f6767277-76d7-4c0a-8b1d-6e396879b7ed tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1729 microversion: 2.1 time: 0.172115 Jul 27 15:33:03.321924 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 291/569] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:03 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:03.343134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:03.343724 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:03.351430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:03.352011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:03.363222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:03.364024 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:03.449693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2f6205c8-4529-492f-9143-4c8d079aeceb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110316 Jul 27 15:33:03.450279 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 279/570] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:33:03 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:33:04.370837 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-a4ff371a-6bbc-4705-a9e6-cac31bba1ae6 req-0dbb875f-83ce-4b2e-b301-1d2fae90917a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a2ca90-8534-41a1-b3e4-4a02f4deba86", "tag": "074b3654-7c9f-4b7d-9969-0aac69d537aa"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:04.380988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=50 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:04.383650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-a4ff371a-6bbc-4705-a9e6-cac31bba1ae6 req-0dbb875f-83ce-4b2e-b301-1d2fae90917a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:04.384117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-a4ff371a-6bbc-4705-a9e6-cac31bba1ae6 req-0dbb875f-83ce-4b2e-b301-1d2fae90917a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:04.401785 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-a4ff371a-6bbc-4705-a9e6-cac31bba1ae6 req-0dbb875f-83ce-4b2e-b301-1d2fae90917a service nova] Creating event network-changed:074b3654-7c9f-4b7d-9969-0aac69d537aa for instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 on hv-cinder-84131 Jul 27 15:33:04.407134 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-a4ff371a-6bbc-4705-a9e6-cac31bba1ae6 req-0dbb875f-83ce-4b2e-b301-1d2fae90917a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039979 Jul 27 15:33:04.408254 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 292/571] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:04.422044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:04.422572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:04.429974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:04.430566 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:04.431434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:04.432128 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:04.521585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lazy-loading 'services' on Instance uuid b030b650-ce61-4238-821f-51cc611f0e67 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:33:04.610884 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-273e21ab-5206-476e-9554-774449258ed2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67/os-volume_attachments/4d6669f5-75ac-4f1d-b00a-2825a437d0bc" status: 202 len: 0 microversion: 2.1 time: 0.193111 Jul 27 15:33:04.612706 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 280/572] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:33:04 2022] DELETE /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67/os-volume_attachments/4d6669f5-75ac-4f1d-b00a-2825a437d0bc => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:33:05.744216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:05.744798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:05.751065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:05.752272 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:05.753034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:05.753473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:05.778113 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:33:05.861896 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ee4b7049-317a-4462-a6d6-f041d559d0de tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 204 len: 0 microversion: 2.1 time: 0.121598 Jul 27 15:33:05.862634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 293/573] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:33:05 2022] DELETE /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:33:05.872028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:05.872801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:05.879998 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:05.880441 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:05.881201 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:05.881631 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:06.020846 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:06.028353 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f995bb70-a2a4-4a00-8141-a21078917e78 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1512 microversion: 2.1 time: 0.161263 Jul 27 15:33:06.028912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 281/574] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:05 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:06.423076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-b8bad991-5e7d-4176-bc0a-4258ee80181d req-8fa8cd73-7de4-40ef-9c8a-8e038e60cde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a2ca90-8534-41a1-b3e4-4a02f4deba86", "tag": "074b3654-7c9f-4b7d-9969-0aac69d537aa"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:06.434379 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-b8bad991-5e7d-4176-bc0a-4258ee80181d req-8fa8cd73-7de4-40ef-9c8a-8e038e60cde6 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:06.434944 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-b8bad991-5e7d-4176-bc0a-4258ee80181d req-8fa8cd73-7de4-40ef-9c8a-8e038e60cde6 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:06.448152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-b8bad991-5e7d-4176-bc0a-4258ee80181d req-8fa8cd73-7de4-40ef-9c8a-8e038e60cde6 service nova] Creating event network-changed:074b3654-7c9f-4b7d-9969-0aac69d537aa for instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 on hv-cinder-84131 Jul 27 15:33:06.453292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-b8bad991-5e7d-4176-bc0a-4258ee80181d req-8fa8cd73-7de4-40ef-9c8a-8e038e60cde6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034262 Jul 27 15:33:06.453890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 294/575] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:07.051924 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:07.052521 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:07.059041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:07.059488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:07.060270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:07.060703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:07.198648 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:07.206073 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-85db8213-ffff-407b-b628-d1b614ea32ce tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1512 microversion: 2.1 time: 0.158646 Jul 27 15:33:07.206628 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 282/576] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:07 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:08.227253 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:08.228222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:08.235633 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:08.236210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:08.237455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:08.238066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:08.403185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:08.410766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5898b85f-9107-4f3d-9113-e7a7450e4964 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 200 len: 1512 microversion: 2.1 time: 0.187782 Jul 27 15:33:08.411330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 295/577] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:08 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:08.617799 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-03c538e3-85f0-454e-a7af-2189af138de8 req-68ea8530-eea7-4e1c-b117-d186d53d85f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b030b650-ce61-4238-821f-51cc611f0e67", "name": "network-vif-deleted", "tag": "e7fab7d2-df99-4add-a73d-c71c9a71af46"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:08.629872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-03c538e3-85f0-454e-a7af-2189af138de8 req-68ea8530-eea7-4e1c-b117-d186d53d85f2 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:08.630317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-03c538e3-85f0-454e-a7af-2189af138de8 req-68ea8530-eea7-4e1c-b117-d186d53d85f2 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:08.641953 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-03c538e3-85f0-454e-a7af-2189af138de8 req-68ea8530-eea7-4e1c-b117-d186d53d85f2 service nova] Creating event network-vif-deleted:e7fab7d2-df99-4add-a73d-c71c9a71af46 for instance b030b650-ce61-4238-821f-51cc611f0e67 on hv-cinder-84131 Jul 27 15:33:08.646903 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-03c538e3-85f0-454e-a7af-2189af138de8 req-68ea8530-eea7-4e1c-b117-d186d53d85f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Jul 27 15:33:08.647753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 283/578] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:09.432094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:09.432710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: b030b650-ce61-4238-821f-51cc611f0e67] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:09.439902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:09.440349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:09.441100 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:09.441583 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:09.455850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] HTTP exception thrown: Instance b030b650-ce61-4238-821f-51cc611f0e67 could not be found. Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Request method failure captured: Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 HTTP/1.1 Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vp4fSREMxzhNSytf2_TDH7D73KmhocSOj1nZ-a_235N_DkfamewIsMYwWmhIhYsZKqlmDDPiD_M0knQmEHY5vbOd5ZedaTuUUueAD8f8zLPT7rcJesIi7gXF10NYkZ32xLRkkKDdfoylCyVAZ54rcu8seeVnvxjRx4zXMnKoyyKozI Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 465f32cb4f724c18aad10fca114a1321 Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1075480198 Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:33:09.457479 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/465f32cb4f724c18aad10fca114a1321"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_465f32cb4f724c18aad10fca114a1321", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/465f32cb4f724c18aad10fca114a1321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/465f32cb4f724c18aad10fca114a1321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesSnapshotTestJSON-1075480198 Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 465f32cb4f724c18aad10fca114a1321 Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1075480198 Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesSnapshotTestJSON-1075480198-project Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: d040957e3ea04505bfa9e3b3d7c66f52 Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesSnapshotTestJSON-1075480198-project Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance b030b650-ce61-4238-821f-51cc611f0e67 could not be found. Jul 27 15:33:09.459033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'b030b650-ce61-4238-821f-51cc611f0e67'} Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b030b650-ce61-4238-821f-51cc611f0e67 could not be found. Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:33:09.460048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b030b650-ce61-4238-821f-51cc611f0e67 could not be found. Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b030b650-ce61-4238-821f-51cc611f0e67 could not be found. Jul 27 15:33:09.461508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:09.464231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Returning 404 to user: Instance b030b650-ce61-4238-821f-51cc611f0e67 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:33:09.464231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-df3687b7-1867-46f7-bb9c-eb3d6d59624e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67" status: 404 len: 111 microversion: 2.1 time: 0.030967 Jul 27 15:33:09.464231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 296/579] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:09 2022] GET /compute/v2.1/servers/b030b650-ce61-4238-821f-51cc611f0e67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:33:14.168929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:14.169515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:14.176583 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:14.177026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:14.177797 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:14.178230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:14.207112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a38b7cc3-04a6-48b1-b6a0-88dc1a56d5cf tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments/ff183e5f-68bb-45a2-9b50-9275c11465b6" status: 200 len: 194 microversion: 2.20 time: 0.043398 Jul 27 15:33:14.207684 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 284/580] 10.222.0.36 () {60 vars in 1454 bytes} [Wed Jul 27 15:33:14 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments/ff183e5f-68bb-45a2-9b50-9275c11465b6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:33:14.274582 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:14.275075 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:14.281506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:14.281958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:14.282722 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:14.283157 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:14.404940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lazy-loading 'services' on Instance uuid 0c7540c3-cdec-4257-bea3-93599c6919cc {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:33:14.522872 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f2112106-c2bb-46aa-bb8c-d883d567fcf1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments/ff183e5f-68bb-45a2-9b50-9275c11465b6" status: 202 len: 0 microversion: 2.20 time: 0.252021 Jul 27 15:33:14.523780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 297/581] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Jul 27 15:33:14 2022] DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments/ff183e5f-68bb-45a2-9b50-9275c11465b6 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:33:14.537589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:14.540746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:14.549817 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:14.550465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:14.551613 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:14.552271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:14.596241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-58ee7f6f-bfd0-4a6f-b405-5b31c569d64d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065511 Jul 27 15:33:14.597093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 285/582] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Jul 27 15:33:14 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:33:15.611969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:15.614291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:15.621172 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:15.621627 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:15.622403 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:15.622843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:15.652826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9cd7ebdc-9b16-46d0-ad9e-495fdc9fa865 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045662 Jul 27 15:33:15.653385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 298/583] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Jul 27 15:33:15 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:33:16.667149 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:16.669248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:16.676921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:16.677377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:16.678158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:16.678592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:16.712640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ea201dd7-7d73-4f03-81fe-f1abc2b5f44f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050529 Jul 27 15:33:16.713211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 286/584] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Jul 27 15:33:16 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:33:17.725598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:17.727815 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:17.734931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:17.735708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:17.736496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:17.736958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:17.766618 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0f6fbe7a-4fe4-43dc-86d2-386109b5f3de tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045396 Jul 27 15:33:17.767180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 299/585] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Jul 27 15:33:17 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:33:18.308085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-130657723", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "networks": [{"uuid": "06d35727-8629-40ca-8166-04dcfe2f8e49"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:18.359748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] validate_networks() for [('06d35727-8629-40ca-8166-04dcfe2f8e49', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:33:18.709446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:33:18.709860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:33:18.710390 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:33:18.710790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:33:18.711223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:33:18.719934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:18.720379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:18.721158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:18.721588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:18.737949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Getting quotas for project 465f32cb4f724c18aad10fca114a1321. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:33:18.742567 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Getting quotas for user d040957e3ea04505bfa9e3b3d7c66f52 and project 465f32cb4f724c18aad10fca114a1321. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:33:18.756767 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:33:18.760962 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:33:18.779590 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:18.782072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:18.789537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:18.789997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:18.790757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:18.791284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:18.816492 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-36324e0f-69cb-41c6-8d78-5d9dae5a67c6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511954 Jul 27 15:33:18.822304 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 287/586] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:33:18.825170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cb9860d4-5a27-46af-bc61-41327c28bbb0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049617 Jul 27 15:33:18.825913 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 300/587] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Jul 27 15:33:18 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:18.828377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-03d01e87-4c34-48ed-ab3e-f20a00546f73 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:18.829496 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-03d01e87-4c34-48ed-ab3e-f20a00546f73 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:18.891325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-03d01e87-4c34-48ed-ab3e-f20a00546f73 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:18.891472 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:18.891871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:18.898574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:18.898738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-03d01e87-4c34-48ed-ab3e-f20a00546f73 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1218 microversion: 2.1 time: 0.074375 Jul 27 15:33:18.899020 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:18.911907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 288/588] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:18 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:18.912294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:18.912294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:18.927978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:33:18.943306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:19.010461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-54b67bfe-012b-4142-87ae-d5a3b5b18c33 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 204 len: 0 microversion: 2.20 time: 0.123254 Jul 27 15:33:19.011308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 301/589] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Jul 27 15:33:18 2022] DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 15:33:19.021078 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:19.021690 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:19.027765 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:19.028253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:19.029025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:19.029462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:19.176233 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:19.184483 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:19.185998 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:19.187164 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-adad42eb-feaa-4f1d-8156-beb89995375c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.170783 Jul 27 15:33:19.187731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 289/590] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:19 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:19.921418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:19.922120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:19.929349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:19.929798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:19.930584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:19.931018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:19.994846 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:20.002357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ffe1aec2-6df0-4752-acc3-9d799079ab37 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1222 microversion: 2.1 time: 0.085221 Jul 27 15:33:20.002921 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 302/591] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:19 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:20.212271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:20.212806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:20.219352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:20.219699 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:20.220582 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:20.221028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:20.350815 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:20.358861 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:20.360413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:20.361584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-89e60dfd-9ec0-4272-8e82-07ed1da60e5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.153393 Jul 27 15:33:20.362330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 290/592] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:20 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:21.023336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:21.023977 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:21.030630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:21.031078 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:21.031883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:21.032322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:21.094890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:21.102476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a10ce8a1-9a3a-4f3b-90ad-bc6f47eaf2bc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1270 microversion: 2.1 time: 0.083602 Jul 27 15:33:21.103031 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 303/593] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:21 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:21.386487 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:21.387160 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:21.393549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:21.393986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:21.394816 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:21.395248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:21.612767 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:21.630197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:21.633260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:21.636936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-baa165dc-a74d-4a18-92cc-799eeb3d3169 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1723 microversion: 2.20 time: 0.253569 Jul 27 15:33:21.645914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 291/594] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:21 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:22.124327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:22.125700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:22.133001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:22.133444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:22.134420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:22.135014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:22.219810 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:22.230001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-323f0715-35a0-4cbf-b42f-a0a3f31727c5 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1276 microversion: 2.1 time: 0.109782 Jul 27 15:33:22.231508 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 304/595] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:22 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:22.670681 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:22.671244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:22.679048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:22.679497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:22.680542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:22.681230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:22.686589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:22.800440 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:22.811908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:22.814082 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:22.815636 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-779220df-ef83-434f-b3be-510c744e86d1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 200 len: 1656 microversion: 2.20 time: 0.149161 Jul 27 15:33:22.817308 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 292/596] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:22 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:22.840879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-52849d71-06c3-465c-8404-3e74d6b8a402 req-5bb6c46e-2d32-4a8d-a69c-ce3148198150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7540c3-cdec-4257-bea3-93599c6919cc", "name": "network-vif-deleted", "tag": "43e59693-e433-4779-9d2a-78cbea8c9b08"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:22.868471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-52849d71-06c3-465c-8404-3e74d6b8a402 req-5bb6c46e-2d32-4a8d-a69c-ce3148198150 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:22.868910 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-52849d71-06c3-465c-8404-3e74d6b8a402 req-5bb6c46e-2d32-4a8d-a69c-ce3148198150 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:22.885418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-52849d71-06c3-465c-8404-3e74d6b8a402 req-5bb6c46e-2d32-4a8d-a69c-ce3148198150 service nova] Creating event network-vif-deleted:43e59693-e433-4779-9d2a-78cbea8c9b08 for instance 0c7540c3-cdec-4257-bea3-93599c6919cc on hv-cinder-84131 Jul 27 15:33:22.890938 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-52849d71-06c3-465c-8404-3e74d6b8a402 req-5bb6c46e-2d32-4a8d-a69c-ce3148198150 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074296 Jul 27 15:33:22.892196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 305/597] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:23.251863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:23.252722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:23.258950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:23.259391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:23.260181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:23.260782 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:23.416958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-0a91c419-f19f-4653-baa7-7ad85c84bef0 req-487c32c0-1765-47bb-ad05-732ba80868aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339820f4-eeff-4d01-9541-08838ae46a4d", "tag": "e1ec7320-feb5-4ed7-acdf-8b51111a2c03"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:23.440863 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-0a91c419-f19f-4653-baa7-7ad85c84bef0 req-487c32c0-1765-47bb-ad05-732ba80868aa service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:23.443643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-0a91c419-f19f-4653-baa7-7ad85c84bef0 req-487c32c0-1765-47bb-ad05-732ba80868aa service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:23.463882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-0a91c419-f19f-4653-baa7-7ad85c84bef0 req-487c32c0-1765-47bb-ad05-732ba80868aa service nova] Creating event network-changed:e1ec7320-feb5-4ed7-acdf-8b51111a2c03 for instance 339820f4-eeff-4d01-9541-08838ae46a4d on hv-cinder-84131 Jul 27 15:33:23.470798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-0a91c419-f19f-4653-baa7-7ad85c84bef0 req-487c32c0-1765-47bb-ad05-732ba80868aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058355 Jul 27 15:33:23.481215 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 306/598] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:23.514098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:23.524106 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d761c668-981f-4ae6-a7ec-5749d8eb9472 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1318 microversion: 2.1 time: 0.276075 Jul 27 15:33:23.538611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 293/599] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:23 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:23.840258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:23.841239 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:23.848878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:23.849571 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:23.850496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:23.851080 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:23.870081 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] HTTP exception thrown: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Request method failure captured: Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc HTTP/1.1 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmxJuol-OSo87paFWKy5Mj7hRP8EMPA5c7wVrZl9q3seXpIDejapcF2_5M6VtsporaMnNPdUxeSTsbsmi6ypf4Aq-wN8Km_WHLw71HRUxE6rF6qKgvJg3UJZnfQ8d6v7vTgZTWIjHeFat6cGGuv2HNf_YYO7COMMKUCmhMmUg6v6kk Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:33:23.873284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddfdba8b75e643b485b2237ae070a1b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 7a964a003f8e4f1da603a13eb7f534ca Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:33:23.875145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '0c7540c3-cdec-4257-bea3-93599c6919cc'} Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:33:23.876159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:33:23.877540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:23.880835 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Returning 404 to user: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:33:23.881710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3d0ce1cf-d494-4b3a-8020-5863403b5720 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 404 len: 111 microversion: 2.20 time: 0.045680 Jul 27 15:33:23.883770 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 307/600] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:23 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:33:23.892277 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8e6644a3-b10d-4549-802c-cab8dfc2db2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '.version_select at 0x7f9fd3aa18b0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:23.928095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8e6644a3-b10d-4549-802c-cab8dfc2db2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190150241" status: 204 len: 0 microversion: 2.20 time: 0.039599 Jul 27 15:33:23.928852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 294/601] 10.222.0.36 () {60 vars in 1262 bytes} [Wed Jul 27 15:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190150241 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 15:33:24.545817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:24.546427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:24.554452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:24.555252 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:24.556424 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:24.557147 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:24.560939 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88867a27-3b26-4a63-9ce9-413ba73a797d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'create', calling method: .version_select at 0x7f9fd3a5ea60>, body: {"keypair": {"name": "tempest-keypair-170554821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfHCt8KgLm53wxVAvFIXD60X4+ElQ51ays+/2bfgG7l1iXa86kOKQM1pRh5Cvi6mdM/N/Egvb5nMUJBFJ6YLmwWa0CuJ/UkLnLv/WyOLLP33aKbAT/KjlIIis6k32nGSA=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:24.582844 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-88867a27-3b26-4a63-9ce9-413ba73a797d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:33:24.587641 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-88867a27-3b26-4a63-9ce9-413ba73a797d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for user 7a964a003f8e4f1da603a13eb7f534ca and project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:33:24.628979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88867a27-3b26-4a63-9ce9-413ba73a797d tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.071814 Jul 27 15:33:24.635730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 295/602] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Jul 27 15:33:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 15:33:24.727429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:24.736364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-23eba65e-62c0-4527-9dcd-0fdd95544815 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1318 microversion: 2.1 time: 0.194179 Jul 27 15:33:24.737247 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 308/603] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:24 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:25.759305 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:25.760041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:25.766302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:25.766302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:25.767429 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:25.768121 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:25.944363 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:25.952000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b7a591fa-bd3e-470f-90f1-03d56c78edc6 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1318 microversion: 2.1 time: 0.197170 Jul 27 15:33:25.952591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 296/604] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:25 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:26.004978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-954317227", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bad7c82a-807d-4c47-8386-1a6c9fb4e649"}], "security_groups": [{"name": "tempest-securitygroup--627207116"}], "key_name": "tempest-keypair-170554821", "user_data": "}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:26.116393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] validate_networks() for [('bad7c82a-807d-4c47-8386-1a6c9fb4e649', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:33:26.486771 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:33:26.487190 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:33:26.487659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:33:26.488608 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:33:26.489014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:33:26.497751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:26.498192 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:26.498984 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:26.499418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:26.516049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:33:26.520117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Getting quotas for user 7a964a003f8e4f1da603a13eb7f534ca and project ddfdba8b75e643b485b2237ae070a1b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:33:26.530835 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:33:26.533089 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:33:26.578278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6f4fc25c-0c63-4a83-98e9-fc58b1880b54 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.577625 Jul 27 15:33:26.579149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 309/605] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Jul 27 15:33:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 15:33:26.590260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3d521092-6d30-4d65-b7a6-f32113ac68b2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:26.590864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3d521092-6d30-4d65-b7a6-f32113ac68b2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:26.643818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3d521092-6d30-4d65-b7a6-f32113ac68b2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:26.650965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3d521092-6d30-4d65-b7a6-f32113ac68b2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:26.652515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3d521092-6d30-4d65-b7a6-f32113ac68b2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:26.653591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3d521092-6d30-4d65-b7a6-f32113ac68b2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1280 microversion: 2.20 time: 0.067325 Jul 27 15:33:26.654140 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 297/606] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:26 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:26.973382 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:26.974117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:26.980328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:26.980775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:26.981529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:26.981978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:27.117664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:27.125415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dca54305-ed2b-4a4c-8c89-7ea647816282 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1318 microversion: 2.1 time: 0.155881 Jul 27 15:33:27.125991 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 310/607] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:26 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:27.520610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-25d91f2a-0b3a-4878-9906-56f43bb0e61f req-4cf244af-adb2-4187-8792-166aed60e525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339820f4-eeff-4d01-9541-08838ae46a4d", "name": "network-vif-plugged", "status": "completed", "tag": "e1ec7320-feb5-4ed7-acdf-8b51111a2c03"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:27.531404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-25d91f2a-0b3a-4878-9906-56f43bb0e61f req-4cf244af-adb2-4187-8792-166aed60e525 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:27.531854 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-25d91f2a-0b3a-4878-9906-56f43bb0e61f req-4cf244af-adb2-4187-8792-166aed60e525 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:27.542178 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-25d91f2a-0b3a-4878-9906-56f43bb0e61f req-4cf244af-adb2-4187-8792-166aed60e525 service nova] Creating event network-vif-plugged:e1ec7320-feb5-4ed7-acdf-8b51111a2c03 for instance 339820f4-eeff-4d01-9541-08838ae46a4d on hv-cinder-84131 Jul 27 15:33:27.547385 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-25d91f2a-0b3a-4878-9906-56f43bb0e61f req-4cf244af-adb2-4187-8792-166aed60e525 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035417 Jul 27 15:33:27.548145 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 298/608] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:27.678170 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:27.678664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:27.685506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:27.685955 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:27.686730 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:27.687318 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:27.769624 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:27.778630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:27.782708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:27.784379 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1310ab33-637a-4d07-805b-b64274aa2033 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1340 microversion: 2.20 time: 0.111054 Jul 27 15:33:27.785182 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 311/609] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:27 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1340 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:28.146950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:28.147640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:28.153937 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:28.154379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:28.155124 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:28.155561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:28.294584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:28.303280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-84773a6b-3fbb-46a4-86d3-66c359de8c8e tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1318 microversion: 2.1 time: 0.160463 Jul 27 15:33:28.303880 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 299/610] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:28 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:28.807370 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:28.808786 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:28.816929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:28.817369 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:28.818484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:28.818918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:29.189488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:29.201331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:29.203737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:29.206078 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f78788af-67d2-4432-8d6c-62162190e425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.402831 Jul 27 15:33:29.207199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 312/611] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:28 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:29.324957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:29.326300 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:29.330334 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:29.335190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:29.336044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:29.343309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:29.343309 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:29.434791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-484cdadb-6664-4a3a-9106-f15e97bcc179 req-022fa8d6-ff76-412d-9f2c-401182d0ad85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:29.453496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-484cdadb-6664-4a3a-9106-f15e97bcc179 req-022fa8d6-ff76-412d-9f2c-401182d0ad85 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:29.453939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-484cdadb-6664-4a3a-9106-f15e97bcc179 req-022fa8d6-ff76-412d-9f2c-401182d0ad85 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:29.475781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-484cdadb-6664-4a3a-9106-f15e97bcc179 req-022fa8d6-ff76-412d-9f2c-401182d0ad85 service nova] Creating event network-changed:bd875b01-1fa3-46df-b071-0151f1189b66 for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a on hv-cinder-84131 Jul 27 15:33:29.480847 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-484cdadb-6664-4a3a-9106-f15e97bcc179 req-022fa8d6-ff76-412d-9f2c-401182d0ad85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049743 Jul 27 15:33:29.481774 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 313/612] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:33:29.505186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:29.512849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-478ff981-3863-4cfe-bfde-fc8c83380ebc tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1507 microversion: 2.1 time: 0.191798 Jul 27 15:33:29.513445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 300/613] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:29 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:29.533662 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28dd8bfb-5181-425e-8e02-34b89ecaa65d", "device": "/dev/sdb"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:29.536668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:29.543902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:29.544318 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:29.545124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:29.545554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:29.856902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f71c4a01-93f0-4f0b-a1f4-3e2f0fd48088 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "POST /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327341 Jul 27 15:33:29.857861 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 314/614] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:33:29 2022] POST /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:30.231860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:30.231860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:30.236438 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:30.236929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:30.237738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:30.238350 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:30.443691 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:30.451557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:30.453094 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:30.454220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-452ad418-bff0-423d-bbde-7bb3287480d6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.228531 Jul 27 15:33:30.454786 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 301/615] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:30 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:31.478163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:31.478904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:31.485682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:31.486150 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:31.486931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:31.487371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:31.620840 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:31.629097 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:31.630591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:31.631745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4dce2409-a8d6-4a30-a901-c2df627c833f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.157917 Jul 27 15:33:31.632327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 315/616] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:31 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:31.931730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:31.932319 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:31.939052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:31.939486 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:31.940267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:31.940694 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:31.968805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:33:32.031466 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:32.049786 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e6e7d0a7-4053-456b-9561-00bc4b96daf9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 204 len: 0 microversion: 2.1 time: 0.121894 Jul 27 15:33:32.050526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 302/617] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:33:31 2022] DELETE /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:33:32.058573 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:32.059185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:32.066571 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:32.067044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:32.067810 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:32.068279 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:32.196949 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:32.204442 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5aa400ac-a23b-4ad6-9d39-1a525d69c475 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1579 microversion: 2.1 time: 0.149707 Jul 27 15:33:32.205007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 316/618] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:32 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1579 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:32.654984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:32.655709 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:32.661762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:32.662222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:32.662973 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:32.663404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:32.793318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:32.802005 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:32.803530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:32.804660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9db77330-b6c7-4c7b-b4bc-9b343a4bed88 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.153907 Jul 27 15:33:32.805218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 303/619] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:32 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:33.227101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:33.227703 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:33.234120 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:33.234566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:33.235330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:33.235758 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:33.371018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:33.387882 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6441f9c4-9c21-4228-8f62-6c443f962a9b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1579 microversion: 2.1 time: 0.165049 Jul 27 15:33:33.388462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 317/620] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:33 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:33.828203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:33.828812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:33.836641 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:33.837094 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:33.837862 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:33.838308 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:33.975261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:33.983769 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:33.985378 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:33.986708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c01df253-87a1-45ae-b8c6-f1294db1dfac tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.162521 Jul 27 15:33:33.987556 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 304/621] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:33 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:34.409730 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:34.410348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:34.413062 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:34.419903 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:34.420357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:34.421144 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:34.421587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:34.813844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:34.825466 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bb52746f-05dc-4f75-b5e0-28339883f7a8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1579 microversion: 2.1 time: 0.419287 Jul 27 15:33:34.826350 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 318/622] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:34 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1579 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:35.014669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:35.019104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:35.028714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:35.029404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:35.030365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:35.030809 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:35.206012 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:35.215098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:35.218674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:35.220153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6d0f5a56-b54b-45a5-9ff7-5b13fdc63510 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.212944 Jul 27 15:33:35.222153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 305/623] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:35 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:35.292971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-6c5edcd2-8873-4ae0-9326-3a37e25e3351 req-72f5e5d8-95f7-482c-9916-b8eea37e2e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8114946e-ea8e-4a5a-a622-f2a52620bfae", "name": "network-vif-deleted", "tag": "7a2cde28-b730-487b-8c95-20bfdab253ca"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:35.303741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-6c5edcd2-8873-4ae0-9326-3a37e25e3351 req-72f5e5d8-95f7-482c-9916-b8eea37e2e61 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:35.304217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-6c5edcd2-8873-4ae0-9326-3a37e25e3351 req-72f5e5d8-95f7-482c-9916-b8eea37e2e61 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:35.308706 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:35.319010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-6c5edcd2-8873-4ae0-9326-3a37e25e3351 req-72f5e5d8-95f7-482c-9916-b8eea37e2e61 service nova] Creating event network-vif-deleted:7a2cde28-b730-487b-8c95-20bfdab253ca for instance 8114946e-ea8e-4a5a-a622-f2a52620bfae on hv-cinder-84131 Jul 27 15:33:35.324574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-6c5edcd2-8873-4ae0-9326-3a37e25e3351 req-72f5e5d8-95f7-482c-9916-b8eea37e2e61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Jul 27 15:33:35.325270 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 319/624] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:35.677241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-56596380-5bdb-47cc-8553-40a9c5812e4e req-a0482a0b-8614-41a1-b487-a0e67091f521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "name": "network-vif-plugged", "status": "completed", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:35.687847 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-56596380-5bdb-47cc-8553-40a9c5812e4e req-a0482a0b-8614-41a1-b487-a0e67091f521 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:35.690736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-56596380-5bdb-47cc-8553-40a9c5812e4e req-a0482a0b-8614-41a1-b487-a0e67091f521 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:35.710547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-56596380-5bdb-47cc-8553-40a9c5812e4e req-a0482a0b-8614-41a1-b487-a0e67091f521 service nova] Creating event network-vif-plugged:bd875b01-1fa3-46df-b071-0151f1189b66 for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a on hv-cinder-84131 Jul 27 15:33:35.718506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-56596380-5bdb-47cc-8553-40a9c5812e4e req-a0482a0b-8614-41a1-b487-a0e67091f521 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045081 Jul 27 15:33:35.719441 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 306/625] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:35.854395 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:35.855185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:35.863183 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:35.863675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:35.864493 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:35.864950 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:35.938175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:35.948999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-90a6005c-ea26-4ad1-bf39-85c8784ea818 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1226 microversion: 2.1 time: 0.099761 Jul 27 15:33:35.950920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 320/626] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:35 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:36.249321 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:36.250863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:36.260726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:36.261201 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:36.261957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:36.262392 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:36.436387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:36.447579 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:36.449143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:36.450271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4329566d-66e8-4bc7-8227-988dcb2bf4b4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.208126 Jul 27 15:33:36.450838 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 307/627] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:36 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:36.972702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:36.973850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:36.975871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:36.976531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:36.983692 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:36.984236 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:36.985037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:36.985568 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:37.017686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:37.018174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:37.018673 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lazy-loading 'fault' on Instance uuid 8114946e-ea8e-4a5a-a622-f2a52620bfae {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:33:37.063599 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:37.073800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c63a5821-6eda-4da4-ad3c-8a3287cbaac8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 200 len: 1231 microversion: 2.1 time: 0.105743 Jul 27 15:33:37.074374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 321/628] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:36 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:37.477030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:37.477610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:37.479539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=14 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:37.485822 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:37.486270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:37.487149 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:37.487567 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:37.661095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:37.669413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:37.670967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:37.672077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-160aab72-c7ce-4cf4-92a9-2e2226f3e635 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.201976 Jul 27 15:33:37.672645 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 308/629] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:37 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:38.102323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:38.102930 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:38.110123 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:38.110607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:38.111373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:38.111804 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:38.130489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] HTTP exception thrown: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Request method failure captured: Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae HTTP/1.1 Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VnuBsol1KCJ2uvJEfXRa3j9wcPyTwz_ielSr9hwagnkjeShCITw6dSXA39Jfqn7HK5sHdF6GFFE4m-Z2CIZz4x-q0m8zIgkOoaLw7xYftaGQlpb5yds0WlO1g32ta4GhsZP4V4CGSTWamPkmlYml6XHfDqPM_XDPpWZz7qVQwB811g Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:33:38.132189 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3fd186ce4ca4030b191309f43d43baa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: d737eac8ae0343df9ace919d75596800 Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:33:38.133527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '8114946e-ea8e-4a5a-a622-f2a52620bfae'} Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:33:38.134292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:33:38.135612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:38.137133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Returning 404 to user: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:33:38.137133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-303fc83a-b52e-4620-b6eb-3949b14c4438 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 404 len: 111 microversion: 2.1 time: 0.035746 Jul 27 15:33:38.137133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 322/630] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:38 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:33:38.298267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1061224389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1638862773", "security_groups": [{"name": "tempest-secgroup-smoke-1358726124"}], "block_device_mapping_v2": [{"uuid": "1bedb102-394d-4285-8de3-892e52c0dada", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03d84d0-4188-403f-a4d9-b8ed9de732b3"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:38.429044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] validate_networks() for [('a03d84d0-4188-403f-a4d9-b8ed9de732b3', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:33:38.695896 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:38.696499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:38.702671 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:38.703148 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:38.703960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:38.704402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:38.868394 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:38.877505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:38.879257 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:38.880413 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-26bd681a-c9a8-4e86-9146-6986438dadb3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.188467 Jul 27 15:33:38.881039 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 323/631] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:38 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:38.921187 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:33:38.922005 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:33:38.922995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:33:38.923668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:33:38.924408 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:33:38.935283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:38.935749 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:38.936561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:38.936990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:38.954729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for project d3fd186ce4ca4030b191309f43d43baa. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:33:38.968150 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for user d737eac8ae0343df9ace919d75596800 and project d3fd186ce4ca4030b191309f43d43baa. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:33:39.035031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:33:39.037722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bedb102-394d-4285-8de3-892e52c0dada',volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:33:39.195633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bf4e233f-85cf-469f-998f-cead697369a0 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.901444 Jul 27 15:33:39.196327 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 309/632] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:33:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:33:39.208036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2895ba33-a094-4fbd-86de-6dd2ae641d97 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:39.208662 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2895ba33-a094-4fbd-86de-6dd2ae641d97 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:39.269138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2895ba33-a094-4fbd-86de-6dd2ae641d97 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:39.277976 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2895ba33-a094-4fbd-86de-6dd2ae641d97 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1095 microversion: 2.1 time: 0.074352 Jul 27 15:33:39.278685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 324/633] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:39 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:39.906548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:39.907062 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:39.914044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:39.914482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:39.915237 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:39.915974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:40.065457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:40.074806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:40.076382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:40.077506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e7d6935b-9d36-483b-bd65-3e1fcaffab98 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.176025 Jul 27 15:33:40.078140 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 310/634] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:39 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:40.300029 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:40.300575 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:40.308685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:40.309131 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:40.309895 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:40.310323 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:40.377942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:40.384832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-879f9c67-30ac-432b-834b-17db95852590 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1145 microversion: 2.1 time: 0.088689 Jul 27 15:33:40.385564 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 325/635] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:40 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:41.108736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:41.109598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:41.116397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:41.116912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:41.117751 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:41.118160 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:41.300877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:41.313643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:41.316805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:41.318518 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-effaa8aa-259e-45d5-b5cf-9a3fccd380ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1405 microversion: 2.20 time: 0.221674 Jul 27 15:33:41.319326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 311/636] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:41 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:41.411391 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:41.412009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:41.421365 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:41.422152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:41.423446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:41.424221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:41.523560 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:41.532918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9a3b96ab-908e-4e4f-a432-e3de4710d15b tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1137 microversion: 2.1 time: 0.125399 Jul 27 15:33:41.533851 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 326/637] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:41 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1137 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:42.343158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:42.343852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:42.356954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:42.357405 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:42.358185 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:42.358616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:42.361515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:42.497463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:42.509246 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:42.511610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:42.513372 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6b5eb0eb-87c8-4202-a57e-457b2ce0b3ee tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1597 microversion: 2.20 time: 0.173978 Jul 27 15:33:42.514241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 312/638] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:33:42 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:33:42.538048 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:42.538609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:42.545257 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:42.545702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:42.546470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:42.546906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:42.558196 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:42.558814 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:42.566722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:42.567122 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:42.568046 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:42.568760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:42.632510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-03a3554e-8815-49ae-8ac7-6e715d1c8438 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098783 Jul 27 15:33:42.633434 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 327/639] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Jul 27 15:33:42 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:33:42.638341 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:42.646913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bc483b4f-cfc0-4a12-a553-4b36451a1883 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1201 microversion: 2.1 time: 0.092837 Jul 27 15:33:42.647490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 313/640] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:42 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:43.667723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:43.668575 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:43.675337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:43.677987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:43.678333 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:43.679381 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:43.711776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-234a6917-bcff-4c35-825b-b86c78d9c950 req-05d26fa8-8060-48f9-9d90-4e29afe5128d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:43.723267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-234a6917-bcff-4c35-825b-b86c78d9c950 req-05d26fa8-8060-48f9-9d90-4e29afe5128d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:43.724072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-234a6917-bcff-4c35-825b-b86c78d9c950 req-05d26fa8-8060-48f9-9d90-4e29afe5128d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:43.740836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-234a6917-bcff-4c35-825b-b86c78d9c950 req-05d26fa8-8060-48f9-9d90-4e29afe5128d service nova] Creating event network-changed:bd875b01-1fa3-46df-b071-0151f1189b66 for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a on hv-cinder-84131 Jul 27 15:33:43.748915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-234a6917-bcff-4c35-825b-b86c78d9c950 req-05d26fa8-8060-48f9-9d90-4e29afe5128d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040513 Jul 27 15:33:43.751393 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 314/641] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:33:43.752986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:43.761861 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-092ea17f-9c3f-462a-8777-24596927ae2c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1201 microversion: 2.1 time: 0.098590 Jul 27 15:33:43.762443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 328/642] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:43 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:44.791051 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:44.791817 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:44.799038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:44.799583 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:44.800444 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:44.800888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:44.886843 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:44.900957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5e15edf0-e415-47f0-8e1c-57863162c992 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1201 microversion: 2.1 time: 0.116381 Jul 27 15:33:44.918430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 315/643] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:44 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1201 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:45.927378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:45.928719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:45.936419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:45.937000 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:45.938327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:45.938737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:46.108486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:46.117686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ea578e26-cbfb-499e-ad46-500c2ab66ef7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1279 microversion: 2.1 time: 0.195020 Jul 27 15:33:46.118639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 329/644] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:45 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:47.012461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-065dcc5d-e88b-43af-a994-c8f5cbcf4497 req-3b42fbca-2e49-4f52-b008-ea5a23881e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615fb0b3-46e9-4b6e-80d1-0dbcce67d082", "tag": "91e538f2-eb06-41ad-a122-92406428be4c"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:47.028382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-065dcc5d-e88b-43af-a994-c8f5cbcf4497 req-3b42fbca-2e49-4f52-b008-ea5a23881e64 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:47.029521 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-065dcc5d-e88b-43af-a994-c8f5cbcf4497 req-3b42fbca-2e49-4f52-b008-ea5a23881e64 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:47.046604 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-065dcc5d-e88b-43af-a994-c8f5cbcf4497 req-3b42fbca-2e49-4f52-b008-ea5a23881e64 service nova] Creating event network-changed:91e538f2-eb06-41ad-a122-92406428be4c for instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 on hv-cinder-84131 Jul 27 15:33:47.053171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-065dcc5d-e88b-43af-a994-c8f5cbcf4497 req-3b42fbca-2e49-4f52-b008-ea5a23881e64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044674 Jul 27 15:33:47.054063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 316/645] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:47.139385 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:47.140073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:47.147494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:47.148125 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:47.148955 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:47.149456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:47.336470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:47.347720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bf9f46fb-d78b-4326-ab6a-e31c12d1a422 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.211665 Jul 27 15:33:47.348782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 330/646] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:47 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:48.390129 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:48.391085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:48.406972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:48.407748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:48.409375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:48.410769 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:48.577984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:48.586144 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c4eb2e84-a044-41ed-ac27-1f6a91db0306 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.203170 Jul 27 15:33:48.587168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 317/647] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:48 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:49.525929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:49.526471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:49.528741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:49.534230 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:49.534748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:49.535519 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:49.535989 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:49.607702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:49.608485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:49.610480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:49.611419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:49.618506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:49.618962 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:49.619744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:49.620210 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:49.630839 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lazy-loading 'services' on Instance uuid 339820f4-eeff-4d01-9541-08838ae46a4d {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:33:49.712579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9492fbdb-5868-4e96-b3db-b7a193b838fe tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "DELETE /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d/os-volume_attachments/28dd8bfb-5181-425e-8e02-34b89ecaa65d" status: 202 len: 0 microversion: 2.1 time: 0.188949 Jul 27 15:33:49.715375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 331/648] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:33:49 2022] DELETE /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d/os-volume_attachments/28dd8bfb-5181-425e-8e02-34b89ecaa65d => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:33:49.789263 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:49.798288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fef8c6c7-377a-4a11-9825-9ce4fb77f0ea tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.194250 Jul 27 15:33:49.802287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 318/649] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:49 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:50.823807 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:50.824722 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:50.831941 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:50.832726 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:50.833522 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:50.834243 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:50.852450 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:50.853080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:50.859591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:50.860134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:50.860837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:50.861270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:50.888366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:33:50.985138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:50.988950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-586370d5-1726-467a-a3e1-792b8861b6d2 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "DELETE /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 204 len: 0 microversion: 2.1 time: 0.140054 Jul 27 15:33:50.989788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 319/650] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:33:50 2022] DELETE /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:33:50.994759 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-23b01dae-db87-4483-858f-ebdb9cbb8aef tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.176336 Jul 27 15:33:50.995342 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 332/651] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:50 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:51.006525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:51.007756 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:51.014015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:51.014457 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:51.015244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:51.015674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:51.154993 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:51.162796 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-120feb22-c878-4546-b481-4c42560eddc8 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1513 microversion: 2.1 time: 0.161349 Jul 27 15:33:51.163387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 320/652] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:50 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:52.016148 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:52.016753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:52.023981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:52.024443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:52.025210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:52.025646 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:52.163821 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:52.171284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-de7c4b8e-aecd-4bbc-b107-e2b0d6d69efb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.159049 Jul 27 15:33:52.171876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 333/653] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:52 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:52.183945 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:52.184558 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:52.191648 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:52.192238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:52.193090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:52.193602 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:52.329789 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:52.338242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-66e57356-5bd5-4c3f-9227-201dad17b846 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1513 microversion: 2.1 time: 0.158135 Jul 27 15:33:52.338920 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 321/654] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:52 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:53.193091 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:53.193843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:53.202611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:53.203154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:53.204136 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:53.204659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:53.353811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:53.358600 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:53.359184 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:53.361866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b0fa510b-7e87-450b-9463-91af52f18c39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.172980 Jul 27 15:33:53.362821 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 334/655] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:53 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:53.367404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:53.367963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:53.368730 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:53.369159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:53.471340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd040957e3ea04505bfa9e3b3d7c66f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465f32cb4f724c18aad10fca114a1321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:53.481551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7e90e544-5741-4bd4-ae46-909a1d78375c tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 200 len: 1471 microversion: 2.1 time: 0.126744 Jul 27 15:33:53.482260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 322/656] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:53 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 1471 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:33:53.513308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-210f6a4f-23a5-422b-9aea-d44ad6e95183 req-427f4ce8-c31c-45a6-9e80-dc98979f7b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339820f4-eeff-4d01-9541-08838ae46a4d", "name": "network-vif-deleted", "tag": "e1ec7320-feb5-4ed7-acdf-8b51111a2c03"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:53.523287 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-210f6a4f-23a5-422b-9aea-d44ad6e95183 req-427f4ce8-c31c-45a6-9e80-dc98979f7b6a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:53.523757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-210f6a4f-23a5-422b-9aea-d44ad6e95183 req-427f4ce8-c31c-45a6-9e80-dc98979f7b6a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:53.534499 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-210f6a4f-23a5-422b-9aea-d44ad6e95183 req-427f4ce8-c31c-45a6-9e80-dc98979f7b6a service nova] Creating event network-vif-deleted:e1ec7320-feb5-4ed7-acdf-8b51111a2c03 for instance 339820f4-eeff-4d01-9541-08838ae46a4d on hv-cinder-84131 Jul 27 15:33:53.540166 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-210f6a4f-23a5-422b-9aea-d44ad6e95183 req-427f4ce8-c31c-45a6-9e80-dc98979f7b6a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Jul 27 15:33:53.540755 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 335/657] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:33:54.384071 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:54.384679 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:54.391348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:54.391788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:54.392573 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:54.393005 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:54.503664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:54.504553 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] [instance: 339820f4-eeff-4d01-9541-08838ae46a4d] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:54.511410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:54.511888 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:54.512707 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:54.513143 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:54.526860 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] HTTP exception thrown: Instance 339820f4-eeff-4d01-9541-08838ae46a4d could not be found. Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Request method failure captured: Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d HTTP/1.1 Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vp4fSREMxzhNSytf2_TDH7D73KmhocSOj1nZ-a_235N_DkfamewIsMYwWmhIhYsZKqlmDDPiD_M0knQmEHY5vbOd5ZedaTuUUueAD8f8zLPT7rcJesIi7gXF10NYkZ32xLRkkKDdfoylCyVAZ54rcu8seeVnvxjRx4zXMnKoyyKozI Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 465f32cb4f724c18aad10fca114a1321 Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1075480198 Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:33:54.528551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/465f32cb4f724c18aad10fca114a1321"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_465f32cb4f724c18aad10fca114a1321", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/465f32cb4f724c18aad10fca114a1321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/465f32cb4f724c18aad10fca114a1321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-VolumesSnapshotTestJSON-1075480198 Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 465f32cb4f724c18aad10fca114a1321 Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1075480198 Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-VolumesSnapshotTestJSON-1075480198-project Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: d040957e3ea04505bfa9e3b3d7c66f52 Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-VolumesSnapshotTestJSON-1075480198-project Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 339820f4-eeff-4d01-9541-08838ae46a4d could not be found. Jul 27 15:33:54.530070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '339820f4-eeff-4d01-9541-08838ae46a4d'} Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339820f4-eeff-4d01-9541-08838ae46a4d could not be found. Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:33:54.531054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339820f4-eeff-4d01-9541-08838ae46a4d could not be found. Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339820f4-eeff-4d01-9541-08838ae46a4d could not be found. Jul 27 15:33:54.532652 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:33:54.533738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:54.533833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] Returning 404 to user: Instance 339820f4-eeff-4d01-9541-08838ae46a4d could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:33:54.533833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-080c2646-2b91-4905-a78f-a1635a37b330 tempest-VolumesSnapshotTestJSON-1075480198 tempest-VolumesSnapshotTestJSON-1075480198-project] 10.222.0.36 "GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d" status: 404 len: 111 microversion: 2.1 time: 0.031034 Jul 27 15:33:54.533833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 336/658] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:54 2022] GET /compute/v2.1/servers/339820f4-eeff-4d01-9541-08838ae46a4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:33:54.541320 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3aefc398-2f35-4061-b281-62c412f050b2 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.161721 Jul 27 15:33:54.542217 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 323/659] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:54 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:55.563490 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:55.564828 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:55.572018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:55.572441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:55.573245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:55.573678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:55.724878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:55.735505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-22bcd393-c9f9-4ade-9a5c-f133d5bf5dba tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.176101 Jul 27 15:33:55.736414 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 337/660] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:55 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:56.765950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:56.766518 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:56.774898 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:56.775393 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:56.776307 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:56.776779 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:56.927858 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:56.939661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f63fe7c3-f2ff-4528-a7c7-87eb824d606f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.177901 Jul 27 15:33:56.940422 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 324/661] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:56 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:57.966519 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:57.967604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:57.973800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:57.974247 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:57.975127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:57.975571 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:58.122698 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:58.125019 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:58.132342 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dc3231a9-1b7a-45a9-a865-96eb854b0dd9 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.169590 Jul 27 15:33:58.132947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 338/662] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:57 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:59.153667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:59.154280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:59.161094 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.161540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.162371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.162802 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.326213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:59.338361 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cedbd184-747f-4ea5-b678-5481a25bc862 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.188147 Jul 27 15:33:59.339102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 325/663] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:33:59 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:59.574372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-03d81687-a121-4b89-8a3c-0115ef592591 req-656fb22b-ed1a-4703-9a57-2b67f57c06ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615fb0b3-46e9-4b6e-80d1-0dbcce67d082", "name": "network-vif-plugged", "status": "completed", "tag": "91e538f2-eb06-41ad-a122-92406428be4c"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:59.592335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-03d81687-a121-4b89-8a3c-0115ef592591 req-656fb22b-ed1a-4703-9a57-2b67f57c06ce service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.592784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-03d81687-a121-4b89-8a3c-0115ef592591 req-656fb22b-ed1a-4703-9a57-2b67f57c06ce service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.612849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:59.613312 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:59.615894 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-03d81687-a121-4b89-8a3c-0115ef592591 req-656fb22b-ed1a-4703-9a57-2b67f57c06ce service nova] Creating event network-vif-plugged:91e538f2-eb06-41ad-a122-92406428be4c for instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 on hv-cinder-84131 Jul 27 15:33:59.621560 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-03d81687-a121-4b89-8a3c-0115ef592591 req-656fb22b-ed1a-4703-9a57-2b67f57c06ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051370 Jul 27 15:33:59.622278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 339/664] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:59.623404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.624269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.624651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.636988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.752557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lazy-loading 'services' on Instance uuid 77a2ca90-8534-41a1-b3e4-4a02f4deba86 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:33:59.846476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3dc7dc4b-f262-4fc7-a210-4388ee9bdcf6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments/9b304f89-9eab-4344-9cdc-1dd964448207" status: 202 len: 0 microversion: 2.1 time: 0.236566 Jul 27 15:33:59.847318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 326/665] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:33:59 2022] DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments/9b304f89-9eab-4344-9cdc-1dd964448207 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:33:59.857798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:59.860281 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:33:59.867635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.868171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.868982 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:33:59.869745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:33:59.908135 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3694ea4f-521a-427b-aebf-8ea05fa8014f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054411 Jul 27 15:33:59.916689 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 340/666] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:33:59 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:34:00.362110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:00.362801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:00.370724 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:00.371302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:00.372215 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:00.372831 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:00.530710 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:00.533087 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:00.539967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-667d55de-9645-4066-a38e-9c6754e6f1b7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.182936 Jul 27 15:34:00.540532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 327/667] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:00 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:00.926585 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:00.929488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:00.935960 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:00.936418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:00.937274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:00.937986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:00.971207 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4e6a8c28-3cb3-4bd3-bf01-31f841d13785 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049635 Jul 27 15:34:00.971789 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 341/668] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:34:00 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:01.562897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:01.563867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:01.573667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:01.574120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:01.574892 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:01.575329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:01.732846 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:01.740910 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-825def57-06c9-4e0c-9a40-14c79d101564 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1267 microversion: 2.1 time: 0.183686 Jul 27 15:34:01.741498 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 328/669] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:01 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:01.990419 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:01.993745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:02.003618 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.004324 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.005509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.006725 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.057187 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0bf42136-3d17-4a75-bea3-e89894dfcf50 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074958 Jul 27 15:34:02.058248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 342/670] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:34:01 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:34:02.150783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:02.151284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:02.154571 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:02.158560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.159009 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.159793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.160283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.202581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:34:02.327798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-34797387-fdd1-4b2f-bcad-3f108bb5ccf7 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 204 len: 0 microversion: 2.1 time: 0.182693 Jul 27 15:34:02.328751 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 329/671] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:34:02 2022] DELETE /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:34:02.345090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:02.346206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:02.355598 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.356447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.357322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.357753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.551113 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:02.567313 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4db5e6f6-46e5-4273-ac99-29ec02454bd4 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1689 microversion: 2.1 time: 0.231771 Jul 27 15:34:02.569315 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 343/672] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:02 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:02.764645 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:02.765333 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:02.772249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.772699 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.773459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.773895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.941168 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:02.952253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ec9ad0c5-3a71-4629-9b2b-0aee7ebadf91 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1455 microversion: 2.1 time: 0.191791 Jul 27 15:34:02.953052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 330/673] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:02 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1455 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:02.974334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:02.975471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:02.981830 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.982275 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:02.983067 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:02.983477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:03.137871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:03.145556 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6e5ebfb5-393b-4b93-9cbb-697e0c0fb75e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1455 microversion: 2.1 time: 0.174995 Jul 27 15:34:03.146129 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 344/674] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:02 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:03.596986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:03.597933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:03.604844 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:03.605294 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:03.606066 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:03.606495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:03.867760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:03.877292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9e042952-8220-498f-9f69-11c28889e835 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1689 microversion: 2.1 time: 0.285205 Jul 27 15:34:03.878048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 331/675] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:03 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1689 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:04.907822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:04.909069 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:04.914084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=58 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:04.923512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:04.924454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:04.925907 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:04.926763 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:05.059588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-bdf40da4-a2bb-4335-a94c-e29061680b77 req-3b7f1dfc-e7c6-4234-8a33-3c4c4a159e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615fb0b3-46e9-4b6e-80d1-0dbcce67d082", "tag": "91e538f2-eb06-41ad-a122-92406428be4c"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:05.070902 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-bdf40da4-a2bb-4335-a94c-e29061680b77 req-3b7f1dfc-e7c6-4234-8a33-3c4c4a159e5b service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:05.071495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-bdf40da4-a2bb-4335-a94c-e29061680b77 req-3b7f1dfc-e7c6-4234-8a33-3c4c4a159e5b service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:05.084161 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-bdf40da4-a2bb-4335-a94c-e29061680b77 req-3b7f1dfc-e7c6-4234-8a33-3c4c4a159e5b service nova] Creating event network-changed:91e538f2-eb06-41ad-a122-92406428be4c for instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 on hv-cinder-84131 Jul 27 15:34:05.089910 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-bdf40da4-a2bb-4335-a94c-e29061680b77 req-3b7f1dfc-e7c6-4234-8a33-3c4c4a159e5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105077 Jul 27 15:34:05.090527 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 332/676] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:05.098919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:05.107530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2e90b77c-1abd-4bcf-8023-cd8d0056aacc tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1689 microversion: 2.1 time: 0.207333 Jul 27 15:34:05.108148 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 345/677] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:04 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1689 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:06.000571 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:06.002967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:06.010678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.011131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.011936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.012376 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.042266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-14e1e896-1f9f-4942-a5ef-cdc08aedb4cb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046042 Jul 27 15:34:06.042818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 333/678] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:34:05 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:34:06.115575 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:06.116468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:06.126836 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.127701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.128919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.129692 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.132430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:06.133324 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:06.140979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.141714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.142836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.143507 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.164049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:34:06.250449 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-18844a36-d4a1-4bbf-9808-0136285420df tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 204 len: 0 microversion: 2.1 time: 0.138867 Jul 27 15:34:06.251332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 346/679] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:34:06 2022] DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:34:06.260981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:06.261680 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:06.268327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.268817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.269630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:06.270146 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:06.299459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:06.308247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3ed49ca3-67f3-479f-a2fa-247647879be6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1689 microversion: 2.1 time: 0.181707 Jul 27 15:34:06.308883 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 334/680] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:06 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:06.421654 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:06.429522 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d90ff6ed-0ba2-4209-a1db-74d63dee50e0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1674 microversion: 2.1 time: 0.173438 Jul 27 15:34:06.430091 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 347/681] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:06 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:07.329805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:07.330335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:07.336831 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:07.337275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:07.338023 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:07.338448 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:07.451055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:07.451702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:07.458337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:07.458791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:07.459566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:07.460038 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:07.473816 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:07.482045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb7f33ba-88e1-4c45-b54a-46847b358ac1 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1689 microversion: 2.1 time: 0.156132 Jul 27 15:34:07.482607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 335/682] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:07 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:07.590684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:07.598719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5587b159-3e57-4f62-a1b2-582c6e27a23f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1674 microversion: 2.1 time: 0.151671 Jul 27 15:34:07.599283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 348/683] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:07 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:08.505598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:08.506220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:08.512836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:08.513283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:08.514044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:08.514481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:08.620208 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:08.620903 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:08.627920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:08.628376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:08.629143 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:08.629580 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:08.644192 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:08.651913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5c03d295-c2f3-4816-98ce-c25112570a6f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1689 microversion: 2.1 time: 0.150273 Jul 27 15:34:08.652482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 336/684] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:08 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:08.765377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:08.772732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e157cc1a-07f4-42dc-a634-74626ebb8d34 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1674 microversion: 2.1 time: 0.156893 Jul 27 15:34:08.773291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 349/685] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:08 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:09.676724 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:09.677353 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:09.691026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:09.691717 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:09.692935 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:09.693530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:09.793635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:09.794833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:09.802121 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:09.802807 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:09.806083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:09.807051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:09.826827 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:09.842656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ada944cf-8d18-4460-bafc-d0a9e2c9365f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 200 len: 1622 microversion: 2.1 time: 0.172580 Jul 27 15:34:09.843996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 337/686] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:09 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 1622 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:10.032489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:10.049476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4ee99f49-c7a4-4211-9fda-e26c668b2366 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1674 microversion: 2.1 time: 0.255232 Jul 27 15:34:10.063972 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 350/687] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:09 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:10.124550 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-76dbbb5b-478a-4014-9cb8-52ea879f9fdc req-c2e6b1f2-f4f3-4ff3-a112-378f8df0cffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a2ca90-8534-41a1-b3e4-4a02f4deba86", "name": "network-vif-deleted", "tag": "074b3654-7c9f-4b7d-9969-0aac69d537aa"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:10.138722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-76dbbb5b-478a-4014-9cb8-52ea879f9fdc req-c2e6b1f2-f4f3-4ff3-a112-378f8df0cffc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:10.139203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-76dbbb5b-478a-4014-9cb8-52ea879f9fdc req-c2e6b1f2-f4f3-4ff3-a112-378f8df0cffc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:10.156885 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-76dbbb5b-478a-4014-9cb8-52ea879f9fdc req-c2e6b1f2-f4f3-4ff3-a112-378f8df0cffc service nova] Creating event network-vif-deleted:074b3654-7c9f-4b7d-9969-0aac69d537aa for instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 on hv-cinder-84131 Jul 27 15:34:10.164435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-76dbbb5b-478a-4014-9cb8-52ea879f9fdc req-c2e6b1f2-f4f3-4ff3-a112-378f8df0cffc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145482 Jul 27 15:34:10.165045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 338/688] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:34:10.629814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-702928b5-08b1-4c36-83bf-5e213023a7a7 req-1286903a-362a-40bf-aa27-8e159da5f679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba023b6d-f35a-4213-979f-652a4c79acd9", "name": "network-vif-deleted", "tag": "3f864415-ce7a-4cf3-afb1-cbde9b6bb602"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:10.641717 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-702928b5-08b1-4c36-83bf-5e213023a7a7 req-1286903a-362a-40bf-aa27-8e159da5f679 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:10.642348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-702928b5-08b1-4c36-83bf-5e213023a7a7 req-1286903a-362a-40bf-aa27-8e159da5f679 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:10.655420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-702928b5-08b1-4c36-83bf-5e213023a7a7 req-1286903a-362a-40bf-aa27-8e159da5f679 service nova] Creating event network-vif-deleted:3f864415-ce7a-4cf3-afb1-cbde9b6bb602 for instance ba023b6d-f35a-4213-979f-652a4c79acd9 on hv-cinder-84131 Jul 27 15:34:10.661310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-702928b5-08b1-4c36-83bf-5e213023a7a7 req-1286903a-362a-40bf-aa27-8e159da5f679 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035471 Jul 27 15:34:10.662550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 351/689] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:10.869335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:10.870683 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 77a2ca90-8534-41a1-b3e4-4a02f4deba86] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:10.882345 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:10.883214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:10.884061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:10.884506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:10.906074 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] HTTP exception thrown: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 could not be found. Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Request method failure captured: Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 HTTP/1.1 Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4Vmj2-Uq8N8Yexb4Xf21A8zhJi8OiiyAEh7fjMMvt05Sacnem1jbCU-7l3M9nKZ7rX5cwMHn3bBOutSk62C9Ol5QQtWZIgV98Nq7UsHiDr4JmvyYSZrYEMEoTI80yaowyGAxb05l0HUSBpB4iXN4Hwy3pc2gDVyES2r9qHll9iS_nCA Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:34:10.907746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_736d8803a13e4dddb1ef32b7ab11eb1c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 51657a0e4865469999bdf8cd5102dad1 Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 could not be found. Jul 27 15:34:10.909409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '77a2ca90-8534-41a1-b3e4-4a02f4deba86'} Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 could not be found. Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:34:10.910268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 could not be found. Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 could not be found. Jul 27 15:34:10.911727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:34:10.915737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Returning 404 to user: Instance 77a2ca90-8534-41a1-b3e4-4a02f4deba86 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:34:10.916670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ad4442b0-4069-40bc-a905-8206acc5ed6b tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86" status: 404 len: 111 microversion: 2.1 time: 0.052598 Jul 27 15:34:10.917241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 339/690] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:10 2022] GET /compute/v2.1/servers/77a2ca90-8534-41a1-b3e4-4a02f4deba86 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:10.926483 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-10918a41-b0a4-45e1-87b8-bff7859e4cc9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '.version_select at 0x7f9fe02cc040>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:10.947066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-10918a41-b0a4-45e1-87b8-bff7859e4cc9 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206466831" status: 202 len: 0 microversion: 2.1 time: 0.024935 Jul 27 15:34:10.947791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 352/691] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Jul 27 15:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206466831 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:34:11.075676 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:11.076379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:11.083011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:11.083695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:11.087542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:11.091780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:11.150486 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:11.150969 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:11.151404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lazy-loading 'fault' on Instance uuid ba023b6d-f35a-4213-979f-652a4c79acd9 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:34:11.234662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:11.245872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8bf74fab-7dbe-4aaf-85c4-0518d147e03b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 200 len: 1327 microversion: 2.1 time: 0.174331 Jul 27 15:34:11.261077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 340/692] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:11 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 1327 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:12.269196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:12.269969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:12.277418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:12.277867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:12.278619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:12.279074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:12.292404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] HTTP exception thrown: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Request method failure captured: Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 HTTP/1.1 Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmrfWRHB8cBN4OCMBGUx_pWc5d08jNMvBgzV-NY-QaEXCHbtHYGVZsYHFP69O1r68IeJW1vtuj-eWWpQR6nXGrfqe1rKAJFABpCNyyfHc7Fi9v4xz5LAtpE2Twqls4m1FWVoodPJeJYBptL3kUFNT1b2cIU_X75A67FyWhz_ahjgGU Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:34:12.293995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fddbf2261d1f42d0a41aa921197fc181", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: a2b027a2c8dd4459b1309faab28f3d4b Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:34:12.295530 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'ba023b6d-f35a-4213-979f-652a4c79acd9'} Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:34:12.296389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:34:12.297545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:12.298617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Returning 404 to user: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:34:12.298617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e8c91661-9165-4a6c-8fe7-c883218d53cd tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 404 len: 111 microversion: 2.1 time: 0.030145 Jul 27 15:34:12.298617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 353/693] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:12 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:12.304573 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-030a33df-490c-43dd-a781-7b4fb2d4c0fb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '.version_select at 0x7f9fd3a33b80>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:12.324187 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-030a33df-490c-43dd-a781-7b4fb2d4c0fb tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925597554" status: 202 len: 0 microversion: 2.1 time: 0.023817 Jul 27 15:34:12.324748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 341/694] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Jul 27 15:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925597554 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:34:12.946643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6acd2fe2-0271-45d9-9bb4-547360725149 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: .version_select at 0x7f9fe0420e50>, body: {"keypair": {"name": "tempest-keypair-448920325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9I3kzvtHLj0t2R0JXNjEZR7o+cFJBV8o3gKI5EzIhvfveoT4qIGd3COWbkXcDhTXHcEVlmnhNIouG2OX4gju31A6byIpmY5/T1nPf1VjCEgnv6G++OwP+yPvL7MDMQGA=="}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:12.962334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-6acd2fe2-0271-45d9-9bb4-547360725149 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for project fddbf2261d1f42d0a41aa921197fc181. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:34:12.966213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-6acd2fe2-0271-45d9-9bb4-547360725149 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for user a2b027a2c8dd4459b1309faab28f3d4b and project fddbf2261d1f42d0a41aa921197fc181. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:34:12.994054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6acd2fe2-0271-45d9-9bb4-547360725149 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051806 Jul 27 15:34:12.994649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 354/695] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:34:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:14.015548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:14.016164 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:14.023758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:14.024380 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:14.025224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:14.025752 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:14.052013 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:34:14.134034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9c6dd8ef-04bc-4480-bf52-8bd2e27ec02e tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 204 len: 0 microversion: 2.1 time: 0.122441 Jul 27 15:34:14.134856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 342/696] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:34:14 2022] DELETE /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:34:14.144971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:14.146095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:14.157316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:14.157778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:14.158636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:14.159078 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:14.220346 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-764521166", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c38721ce-4da8-41f0-9615-4459de2daf25"}], "security_groups": [{"name": "tempest-securitygroup--1288134101"}], "key_name": "tempest-keypair-448920325", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:14.311270 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:14.319265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dbf41309-8792-416f-b943-77187464a01a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1507 microversion: 2.1 time: 0.180448 Jul 27 15:34:14.319887 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 355/697] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:14 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:14.328305 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] validate_networks() for [('c38721ce-4da8-41f0-9615-4459de2daf25', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:34:14.692306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:34:14.692731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:34:14.693232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:34:14.693653 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:34:14.694048 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:34:14.702970 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:14.703417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:14.704254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:14.704689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:14.721600 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for project fddbf2261d1f42d0a41aa921197fc181. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:34:14.726202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Getting quotas for user a2b027a2c8dd4459b1309faab28f3d4b and project fddbf2261d1f42d0a41aa921197fc181. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:34:14.736990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:34:14.739332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:34:14.785081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-46923bf2-9d15-4045-92b9-c8a3f9d8be51 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569482 Jul 27 15:34:14.785870 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 343/698] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:34:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:34:14.796432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-94b2aca1-7c77-41ef-9f69-66eca1a8849f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:14.797122 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-94b2aca1-7c77-41ef-9f69-66eca1a8849f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:14.855706 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-94b2aca1-7c77-41ef-9f69-66eca1a8849f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:14.866358 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-94b2aca1-7c77-41ef-9f69-66eca1a8849f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1236 microversion: 2.1 time: 0.073713 Jul 27 15:34:14.868284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 356/699] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:14 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:15.340891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:15.341492 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:15.348296 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:15.348738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:15.349526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:15.349957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:15.365616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:15.484080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:15.492114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2a270e7f-08af-49a9-98dc-4c738f0c3c0f tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1507 microversion: 2.1 time: 0.155653 Jul 27 15:34:15.492670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 344/700] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:15 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:15.888007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:15.888615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:15.895046 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:15.895485 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:15.896262 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:15.896693 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:15.967604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:15.975387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a5970e8d-12bc-4351-9b18-a131ad0ee0e5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1232 microversion: 2.1 time: 0.091270 Jul 27 15:34:15.976668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 357/701] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:15 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1232 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:16.513803 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:16.515110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:16.523716 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:16.524437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:16.525210 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:16.525651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:16.727664 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:16.749108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-80910a0e-6a00-47d3-8ed0-c30c49762173 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 200 len: 1507 microversion: 2.1 time: 0.238406 Jul 27 15:34:16.750473 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 345/702] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:16 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:16.851691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-4012d029-3e9f-4ac8-ae7d-fef38ba54286 req-ad3f0ba4-fd2b-48a6-8a6b-b8fb54d82c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a75f912-669a-4719-b005-ed9bfc504f4f", "name": "network-vif-deleted", "tag": "d43e69ee-e393-4930-9178-0cc2bbf003dd"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:16.861781 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-4012d029-3e9f-4ac8-ae7d-fef38ba54286 req-ad3f0ba4-fd2b-48a6-8a6b-b8fb54d82c35 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:16.862514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-4012d029-3e9f-4ac8-ae7d-fef38ba54286 req-ad3f0ba4-fd2b-48a6-8a6b-b8fb54d82c35 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:16.876027 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-4012d029-3e9f-4ac8-ae7d-fef38ba54286 req-ad3f0ba4-fd2b-48a6-8a6b-b8fb54d82c35 service nova] Creating event network-vif-deleted:d43e69ee-e393-4930-9178-0cc2bbf003dd for instance 9a75f912-669a-4719-b005-ed9bfc504f4f on hv-cinder-84131 Jul 27 15:34:16.881335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-4012d029-3e9f-4ac8-ae7d-fef38ba54286 req-ad3f0ba4-fd2b-48a6-8a6b-b8fb54d82c35 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033279 Jul 27 15:34:16.882609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 358/703] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:16.999123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:16.999742 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:17.008098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.008548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.009441 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.010026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.083588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:17.092085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b32cbde6-9ac1-4794-81ee-6baaae0b209f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1294 microversion: 2.1 time: 0.097926 Jul 27 15:34:17.092757 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 346/704] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:16 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:17.782488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:17.783095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 9a75f912-669a-4719-b005-ed9bfc504f4f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:17.790288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.790791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.791628 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.792101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.806982 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] HTTP exception thrown: Instance 9a75f912-669a-4719-b005-ed9bfc504f4f could not be found. Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Request method failure captured: Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f HTTP/1.1 Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vmj2-Uq8N8Yexb4Xf21A8zhJi8OiiyAEh7fjMMvt05Sacnem1jbCU-7l3M9nKZ7rX5cwMHn3bBOutSk62C9Ol5QQtWZIgV98Nq7UsHiDr4JmvyYSZrYEMEoTI80yaowyGAxb05l0HUSBpB4iXN4Hwy3pc2gDVyES2r9qHll9iS_nCA Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:34:17.808642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_736d8803a13e4dddb1ef32b7ab11eb1c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 51657a0e4865469999bdf8cd5102dad1 Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 9a75f912-669a-4719-b005-ed9bfc504f4f could not be found. Jul 27 15:34:17.809962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '9a75f912-669a-4719-b005-ed9bfc504f4f'} Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a75f912-669a-4719-b005-ed9bfc504f4f could not be found. Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:34:17.810699 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a75f912-669a-4719-b005-ed9bfc504f4f could not be found. Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a75f912-669a-4719-b005-ed9bfc504f4f could not be found. Jul 27 15:34:17.811925 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:17.815799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Returning 404 to user: Instance 9a75f912-669a-4719-b005-ed9bfc504f4f could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:34:17.815799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-aa2fad9b-645e-423d-bf11-deac161b9473 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f" status: 404 len: 111 microversion: 2.1 time: 0.032398 Jul 27 15:34:17.815799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 359/705] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:17 2022] GET /compute/v2.1/servers/9a75f912-669a-4719-b005-ed9bfc504f4f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:17.818952 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:17.819497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:17.826398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.827104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.828507 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.828950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.857234 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:34:17.942446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5ceddc92-8582-4c82-a207-a184094932c6 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 204 len: 0 microversion: 2.1 time: 0.126956 Jul 27 15:34:17.943236 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 347/706] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:34:17 2022] DELETE /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:34:17.957468 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:17.958083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:17.964886 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.965709 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.966660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:17.967339 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:17.976008 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:18.123443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:18.125072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:18.142522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:18.143623 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:18.145467 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:18.146849 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:18.250017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:18.261289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9513a24f-a783-4b68-a310-735422e93702 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.312042 Jul 27 15:34:18.276793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 360/707] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:17 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:18.350630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:18.363996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7a43a689-7ed8-4979-8094-6707e3f8ee1a tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.248768 Jul 27 15:34:18.365859 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 348/708] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:18 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:18.491804 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-52802e10-35a8-422c-8332-718b1e09bfb7 req-90e0d8d0-2651-41c1-8c48-aaab45259ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c197fd-bf3d-4589-86ed-e771f386c806", "tag": "a0089b98-aa8d-48fa-a318-0cab30dccdb8"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:18.519014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-52802e10-35a8-422c-8332-718b1e09bfb7 req-90e0d8d0-2651-41c1-8c48-aaab45259ce5 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:18.521078 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-52802e10-35a8-422c-8332-718b1e09bfb7 req-90e0d8d0-2651-41c1-8c48-aaab45259ce5 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:18.540701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-52802e10-35a8-422c-8332-718b1e09bfb7 req-90e0d8d0-2651-41c1-8c48-aaab45259ce5 service nova] Creating event network-changed:a0089b98-aa8d-48fa-a318-0cab30dccdb8 for instance 06c197fd-bf3d-4589-86ed-e771f386c806 on hv-cinder-84131 Jul 27 15:34:18.550647 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-52802e10-35a8-422c-8332-718b1e09bfb7 req-90e0d8d0-2651-41c1-8c48-aaab45259ce5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062202 Jul 27 15:34:18.552509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 361/709] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:19.283753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:19.284456 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:19.291714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:19.292183 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:19.292951 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:19.293382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:19.387296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:19.388050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:19.394678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:19.395132 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:19.395936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:19.396380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:19.443415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:19.451787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1fd2795c-bc88-4164-be1c-3c3d0a5c025a tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.172120 Jul 27 15:34:19.452387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 349/710] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:19 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:19.532601 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:19.540664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1c1846b9-9ac3-40c3-ad3a-f05bdf03d786 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.158345 Jul 27 15:34:19.541158 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 362/711] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:19 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:20.473603 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:20.474281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:20.480945 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:20.481398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:20.482162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:20.482601 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:20.562979 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:20.563597 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:20.572186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:20.572651 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:20.573433 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:20.573878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:20.627035 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:20.634988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5572c9f7-a8e2-488b-9dae-f763963598a2 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1522 microversion: 2.1 time: 0.165159 Jul 27 15:34:20.635585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 350/712] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:20 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:20.740720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:20.749241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c35ed8da-98f5-445c-8f4f-ed27efd318de tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.191299 Jul 27 15:34:20.749843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 363/713] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:20 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:21.200617 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-0c3d8bad-0e0b-465e-b8cc-452e0f75f8d3 req-babdb9cb-906c-484a-8a45-0815e27b3f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a82d27-5756-4ee1-8c2e-d6a26bf75f15", "name": "network-vif-deleted", "tag": "3810c698-7926-46e1-9f80-aa481b319cbb"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:21.211234 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0c3d8bad-0e0b-465e-b8cc-452e0f75f8d3 req-babdb9cb-906c-484a-8a45-0815e27b3f2f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:21.211689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0c3d8bad-0e0b-465e-b8cc-452e0f75f8d3 req-babdb9cb-906c-484a-8a45-0815e27b3f2f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:21.222983 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-0c3d8bad-0e0b-465e-b8cc-452e0f75f8d3 req-babdb9cb-906c-484a-8a45-0815e27b3f2f service nova] Creating event network-vif-deleted:3810c698-7926-46e1-9f80-aa481b319cbb for instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 on hv-cinder-84131 Jul 27 15:34:21.228639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-0c3d8bad-0e0b-465e-b8cc-452e0f75f8d3 req-babdb9cb-906c-484a-8a45-0815e27b3f2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031624 Jul 27 15:34:21.229244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 351/714] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:34:21.655802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:21.656535 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:21.663545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:21.664025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:21.664778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:21.665206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:21.726728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51657a0e4865469999bdf8cd5102dad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736d8803a13e4dddb1ef32b7ab11eb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:21.734586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b6ad7ea3-9907-4934-bfbb-44fdaa823fdb tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 200 len: 1480 microversion: 2.1 time: 0.082385 Jul 27 15:34:21.735301 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 364/715] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:21 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 1480 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:21.771176 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:21.771882 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:21.778690 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:21.779025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:21.779863 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:21.780301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:21.909253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:21.918090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8ec5b02e-1a37-4043-b5f8-80ed51c20b1e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.151521 Jul 27 15:34:21.918654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 352/716] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:21 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:22.755561 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:22.756118 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] [instance: 44a82d27-5756-4ee1-8c2e-d6a26bf75f15] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:22.762719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:22.763201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:22.763996 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:22.764432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:22.778159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] HTTP exception thrown: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 could not be found. Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Request method failure captured: Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 HTTP/1.1 Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4Vmj2-Uq8N8Yexb4Xf21A8zhJi8OiiyAEh7fjMMvt05Sacnem1jbCU-7l3M9nKZ7rX5cwMHn3bBOutSk62C9Ol5QQtWZIgV98Nq7UsHiDr4JmvyYSZrYEMEoTI80yaowyGAxb05l0HUSBpB4iXN4Hwy3pc2gDVyES2r9qHll9iS_nCA Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:34:22.779854 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_736d8803a13e4dddb1ef32b7ab11eb1c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/736d8803a13e4dddb1ef32b7ab11eb1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 736d8803a13e4dddb1ef32b7ab11eb1c Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375222305 Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 51657a0e4865469999bdf8cd5102dad1 Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375222305-project Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 could not be found. Jul 27 15:34:22.781330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '44a82d27-5756-4ee1-8c2e-d6a26bf75f15'} Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 could not be found. Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:34:22.782181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 could not be found. Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 could not be found. Jul 27 15:34:22.783552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:34:22.784805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] Returning 404 to user: Instance 44a82d27-5756-4ee1-8c2e-d6a26bf75f15 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:34:22.784805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-05dce0cb-0cc1-4c85-a245-e4741bd0ad42 tempest-ServerRescueNegativeTestJSON-375222305 tempest-ServerRescueNegativeTestJSON-375222305-project] 10.222.0.36 "GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15" status: 404 len: 111 microversion: 2.1 time: 0.029594 Jul 27 15:34:22.784805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 365/717] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:22 2022] GET /compute/v2.1/servers/44a82d27-5756-4ee1-8c2e-d6a26bf75f15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:22.940446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:22.941060 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:22.947433 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:22.947897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:22.948810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:22.949239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:23.195473 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:23.202869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-80e35a09-4b66-4cbe-b743-56c3cb881ac6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.266455 Jul 27 15:34:23.203435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 353/718] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:22 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:24.228853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:24.230095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:24.238624 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:24.239203 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:24.240174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:24.240679 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:24.388005 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:24.397287 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-25aaa1e2-d622-4282-a4ab-90de1e8dbc9e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.176250 Jul 27 15:34:24.410262 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 366/719] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:24 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:25.417869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:25.418533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:25.421381 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:25.422225 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:25.446959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:25.446959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:25.447343 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:25.447746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:25.599423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:25.615189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4735e283-5d43-404a-8e31-ef1340f90ee3 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.201054 Jul 27 15:34:25.616340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 354/720] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:25 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:25.637137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:25.804366 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-c112215c-7259-4fdf-b64b-c6401eb33113 req-6ebc0ee8-0e18-4da7-b202-c8d138e0e630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c197fd-bf3d-4589-86ed-e771f386c806", "name": "network-vif-plugged", "status": "completed", "tag": "a0089b98-aa8d-48fa-a318-0cab30dccdb8"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:25.822498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-c112215c-7259-4fdf-b64b-c6401eb33113 req-6ebc0ee8-0e18-4da7-b202-c8d138e0e630 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:25.823081 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-c112215c-7259-4fdf-b64b-c6401eb33113 req-6ebc0ee8-0e18-4da7-b202-c8d138e0e630 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:25.844639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-c112215c-7259-4fdf-b64b-c6401eb33113 req-6ebc0ee8-0e18-4da7-b202-c8d138e0e630 service nova] Creating event network-vif-plugged:a0089b98-aa8d-48fa-a318-0cab30dccdb8 for instance 06c197fd-bf3d-4589-86ed-e771f386c806 on hv-cinder-84131 Jul 27 15:34:25.853640 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-c112215c-7259-4fdf-b64b-c6401eb33113 req-6ebc0ee8-0e18-4da7-b202-c8d138e0e630 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221726 Jul 27 15:34:25.855490 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 367/721] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:26.637262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:26.638055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:26.645100 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:26.645546 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:26.646325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:26.646755 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:26.849241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:26.857785 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-795de7da-9815-4bf6-9f7b-c0eaba4daa24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.224002 Jul 27 15:34:26.858372 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 355/722] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:26 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:27.510107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:27.510713 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:27.516928 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:27.517369 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:27.518444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:27.518897 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:27.553749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f6c75793-c86e-4cb6-a7bc-5ab1bf1c983b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/ips" status: 200 len: 152 microversion: 2.20 time: 0.302284 Jul 27 15:34:27.553749 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 368/723] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Jul 27 15:34:27 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/ips => generated 152 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:34:27.879003 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:27.879611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:27.891664 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:27.892141 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:27.892914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:27.893343 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:28.097667 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:28.112788 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8fb837d8-2655-4ab3-bcbd-0124d3dc272f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1362 microversion: 2.1 time: 0.237496 Jul 27 15:34:28.113820 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 356/724] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:27 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:29.134870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:29.135495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:29.142574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.143027 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.144138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.144587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.316268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:29.325737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0d591bf1-7ab7-4f1e-9d18-85f718f96601 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1548 microversion: 2.1 time: 0.194104 Jul 27 15:34:29.330914 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 369/725] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:29 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:29.353478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:29.354044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:29.361089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.361681 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.362587 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.363088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.622133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:29.622654 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:29.628918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.629366 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.630126 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.630554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.655400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lazy-loading 'flavor' on Instance uuid 27c0a14c-8873-4689-9e66-43ba0b7c934a {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:34:29.731702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-97f2e9df-62c5-4e56-8fdf-1d39078b8fd2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.382297 Jul 27 15:34:29.733114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 357/726] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:34:29 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-interface => generated 284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:29.874700 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-bfc217f9-be2e-48bc-81c3-e6adaf360331 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/action" status: 202 len: 0 microversion: 2.20 time: 0.256215 Jul 27 15:34:29.876666 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 370/727] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Jul 27 15:34:29 2022] POST /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:34:29.888722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:29.890134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:29.900287 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.901086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:29.902225 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:29.902859 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:30.157537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:30.167185 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:30.169304 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:30.170774 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-941dceab-8020-4ccd-b30b-96792c262c3c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.288218 Jul 27 15:34:30.171943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 358/728] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:29 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:31.047415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-8dc91896-ca85-4a8b-bd30-a1bcb472be8f req-a9069e4f-20b7-41e6-b0b1-c70b79ec76d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c197fd-bf3d-4589-86ed-e771f386c806", "tag": "a0089b98-aa8d-48fa-a318-0cab30dccdb8"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:31.063210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-8dc91896-ca85-4a8b-bd30-a1bcb472be8f req-a9069e4f-20b7-41e6-b0b1-c70b79ec76d7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:31.064181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-8dc91896-ca85-4a8b-bd30-a1bcb472be8f req-a9069e4f-20b7-41e6-b0b1-c70b79ec76d7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:31.082549 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-8dc91896-ca85-4a8b-bd30-a1bcb472be8f req-a9069e4f-20b7-41e6-b0b1-c70b79ec76d7 service nova] Creating event network-changed:a0089b98-aa8d-48fa-a318-0cab30dccdb8 for instance 06c197fd-bf3d-4589-86ed-e771f386c806 on hv-cinder-84131 Jul 27 15:34:31.089792 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-8dc91896-ca85-4a8b-bd30-a1bcb472be8f req-a9069e4f-20b7-41e6-b0b1-c70b79ec76d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050728 Jul 27 15:34:31.095516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 371/729] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:31.196278 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:31.197897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:31.206484 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:31.207330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:31.208506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:31.210118 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:31.554077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:31.566211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:31.570262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:31.573092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cdb798bc-d252-4d8d-ae5d-43fd4e8c3aea tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.381546 Jul 27 15:34:31.574293 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 359/730] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:31 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:32.598213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:32.598920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:32.610069 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:32.610541 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:32.611330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:32.611775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:32.801579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:32.811247 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:32.813196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:32.814405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-eca9d583-2c10-4cf2-9af5-02ba80c35dc7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.221040 Jul 27 15:34:32.815691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 372/731] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:32 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:33.384567 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3a178390-cc84-49d9-a998-e113383ed713 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: .version_select at 0x7f9fd3a335e0>, body: {"keypair": {"name": "tempest-keypair-2138480301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV+yRaUpzbKWU4GtnScyWQrVgq0YP+uVLX4O4czgnjbKjePQjjOqvkhhymNTEhKEakshQ177SWycHm1Nao6SDqG9uKMS/I3wm8Lhp+IJBZjdFLtERA8nNqRWnXtadr67A=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:33.389728 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:33.401535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-3a178390-cc84-49d9-a998-e113383ed713 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:34:33.406291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-3a178390-cc84-49d9-a998-e113383ed713 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:34:33.431989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3a178390-cc84-49d9-a998-e113383ed713 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161647 Jul 27 15:34:33.432595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 360/732] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:34:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:33.839672 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:33.840465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:33.848520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:33.848975 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:33.850471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:33.851074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:34.001791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:34.010784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:34.012683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:34.014074 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d5aea63b-15bd-44a9-b424-ce76ab7c5a09 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.179826 Jul 27 15:34:34.014637 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 373/733] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:33 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:34.771252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-245685621", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb"}], "security_groups": [{"name": "tempest-securitygroup--1956257399"}], "key_name": "tempest-keypair-2138480301", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:34.902624 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] validate_networks() for [('a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:34:35.038858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:35.040142 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:35.047093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:35.048940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:35.049678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:35.050675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:35.051475 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:35.234180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:35.243464 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:35.247445 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:35.249070 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a117cbb9-8aa2-40f5-805e-204687ad2ac4 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.214621 Jul 27 15:34:35.249841 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 374/734] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:35 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:34:35.386216 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:34:35.386638 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:34:35.387125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:34:35.387525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:34:35.387958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:34:35.401612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:35.402066 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:35.402905 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:35.403250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:35.438620 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:34:35.444352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:34:35.459318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:34:35.461716 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:34:35.524501 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a54fbe76-fc8b-4111-8814-61981710488c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.758764 Jul 27 15:34:35.527921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 361/735] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:34:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:34:35.536248 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-32255ef0-8825-4ba0-a4a2-adef0611437f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:35.537115 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-32255ef0-8825-4ba0-a4a2-adef0611437f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:35.603084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-32255ef0-8825-4ba0-a4a2-adef0611437f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:35.611124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-32255ef0-8825-4ba0-a4a2-adef0611437f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1241 microversion: 2.1 time: 0.078785 Jul 27 15:34:35.611793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 375/736] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:35 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:36.274141 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:36.274962 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:36.282991 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:36.284060 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:36.284792 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:36.285734 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:36.289415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:36.450139 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:36.460735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:36.462359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:36.466221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-297e2144-b335-4a0d-a88e-3516c16851dd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.193957 Jul 27 15:34:36.467120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 362/737] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:36 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:36.633390 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:36.633997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:36.643275 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:36.644085 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:36.645464 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:36.646319 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:36.720272 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:36.728962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0fa8b24a-811f-45df-b7af-86176625aa4c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1301 microversion: 2.1 time: 0.100323 Jul 27 15:34:36.730054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 376/738] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:36 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:37.493266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:37.494232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:37.501222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:37.501698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:37.502531 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:37.502967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:37.752744 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:37.754006 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:37.764587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:37.765044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:37.765836 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:37.766274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:37.791823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:37.803318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:37.804895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:37.806087 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cbf30a00-3c0a-444d-a775-fa985a470490 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.319492 Jul 27 15:34:37.806780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 363/739] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:37 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:34:37.906721 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:37.915012 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-87a235d0-542a-42db-a699-2ce378753b9f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1367 microversion: 2.1 time: 0.168158 Jul 27 15:34:37.916423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 377/740] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:37 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:38.218652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-39cc2cca-94ce-402d-82d0-b9a8287b4da4 req-b9d9b58a-f7f5-4315-90f6-2253272e859a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "601af892-ad4b-4797-8590-70c82bc772c3", "tag": "310d1b53-872f-4fbc-8c36-00e4731ac228"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:38.232640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-39cc2cca-94ce-402d-82d0-b9a8287b4da4 req-b9d9b58a-f7f5-4315-90f6-2253272e859a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:38.232994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-39cc2cca-94ce-402d-82d0-b9a8287b4da4 req-b9d9b58a-f7f5-4315-90f6-2253272e859a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:38.248392 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-39cc2cca-94ce-402d-82d0-b9a8287b4da4 req-b9d9b58a-f7f5-4315-90f6-2253272e859a service nova] Creating event network-changed:310d1b53-872f-4fbc-8c36-00e4731ac228 for instance 601af892-ad4b-4797-8590-70c82bc772c3 on hv-cinder-84131 Jul 27 15:34:38.253865 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-39cc2cca-94ce-402d-82d0-b9a8287b4da4 req-b9d9b58a-f7f5-4315-90f6-2253272e859a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039712 Jul 27 15:34:38.254602 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 364/741] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:34:38.832780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:38.833388 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:38.841611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:38.842073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:38.842951 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:38.843388 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:38.937983 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:38.938708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:38.945509 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:38.945951 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:38.946737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:38.951577 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:38.979639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:38.984133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:38.996895 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:38.999742 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:39.001937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7bb8e284-0e4f-4c26-a5e6-6ab8b09c949a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.172778 Jul 27 15:34:39.002963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 378/742] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:38 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:39.093375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:39.101557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-536149ec-815e-405e-9fef-c541bb117544 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1367 microversion: 2.1 time: 0.168309 Jul 27 15:34:39.102180 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 365/743] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:38 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:40.039972 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:40.041223 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:40.049452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:40.050249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:40.051375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:40.051843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:40.122002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:40.122873 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:40.129554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:40.130802 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:40.130977 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:40.131311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:40.201765 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:40.210827 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:40.212363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:40.213544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-243a101b-95d5-47c5-9039-8ee519e06c59 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.178287 Jul 27 15:34:40.214108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 379/744] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:40 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:40.278871 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:40.286390 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-15494da6-47a1-4274-aecd-1f3fc2a03c29 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1367 microversion: 2.1 time: 0.168328 Jul 27 15:34:40.286964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 366/745] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:40 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:41.238009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:41.238568 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:41.245337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:41.245787 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:41.246561 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:41.246994 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:41.306505 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:41.307223 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:41.314284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:41.314736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:41.315506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:41.315967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:41.391004 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:41.399586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:41.401992 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:41.402683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8dd52f8a-2b9b-4247-af13-c9b02b3aaa2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.168737 Jul 27 15:34:41.403245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 380/746] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:41 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:41.451876 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:41.460075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-82c8279b-fd87-48af-bbac-47518e4e2f86 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1367 microversion: 2.1 time: 0.156894 Jul 27 15:34:41.460253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 367/747] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:41 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:41.624072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-eed66f19-c2a1-47dc-b67e-b486a6abd581 req-bb2835ac-ee76-4229-8362-cdcc05fe8fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601af892-ad4b-4797-8590-70c82bc772c3", "name": "network-vif-plugged", "status": "completed", "tag": "310d1b53-872f-4fbc-8c36-00e4731ac228"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:41.634780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-eed66f19-c2a1-47dc-b67e-b486a6abd581 req-bb2835ac-ee76-4229-8362-cdcc05fe8fdc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:41.635243 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-eed66f19-c2a1-47dc-b67e-b486a6abd581 req-bb2835ac-ee76-4229-8362-cdcc05fe8fdc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:41.647168 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-eed66f19-c2a1-47dc-b67e-b486a6abd581 req-bb2835ac-ee76-4229-8362-cdcc05fe8fdc service nova] Creating event network-vif-plugged:310d1b53-872f-4fbc-8c36-00e4731ac228 for instance 601af892-ad4b-4797-8590-70c82bc772c3 on hv-cinder-84131 Jul 27 15:34:41.652180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-eed66f19-c2a1-47dc-b67e-b486a6abd581 req-bb2835ac-ee76-4229-8362-cdcc05fe8fdc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Jul 27 15:34:41.652788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 381/748] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:42.426138 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:42.426678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:42.434090 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:42.434564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:42.435332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:42.435763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:42.482124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:42.482738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:42.489052 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:42.489498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:42.490935 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:42.491372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:42.570925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:42.579104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:42.580657 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:42.581819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-de1a7b70-1b41-4dab-a2f5-a3442d730672 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.160219 Jul 27 15:34:42.582637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 368/749] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:42 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:42.626131 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:42.633566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7f82a071-4f27-4912-b3aa-dbadb4c44523 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1367 microversion: 2.1 time: 0.156154 Jul 27 15:34:42.634138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 382/750] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:42 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:43.606370 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:43.606998 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:43.613537 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:43.613911 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:43.615170 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:43.615592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:43.654149 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:43.654757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:43.661433 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:43.661904 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:43.662697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:43.663125 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:43.746480 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:43.756214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:43.757710 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:43.758897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e8c1aa0d-1a30-4825-a150-a021f9b63d7c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.156428 Jul 27 15:34:43.759449 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 369/751] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:43 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:43.797876 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:43.806078 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8aa824d5-ed4c-4a1a-a50e-c91a5b0108df tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1367 microversion: 2.1 time: 0.155674 Jul 27 15:34:43.806663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 383/752] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:43 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:44.781987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:44.782599 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:44.789138 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:44.789619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:44.790383 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:44.790823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:44.827639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:44.828463 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:44.835858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:44.836321 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:44.837237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:44.837535 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:44.928439 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:44.937426 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:44.938960 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:44.940487 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0efb17b8-8b53-42b5-bd4b-c6a6af3b6dff tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.162073 Jul 27 15:34:44.941109 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 370/753] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:44 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:44.974701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:44.982201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2e1f6a69-56c1-44ca-9c7e-553e9ac94a3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1558 microversion: 2.1 time: 0.158252 Jul 27 15:34:44.982768 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 384/754] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:34:44 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:45.003717 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:45.004169 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:45.010296 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:45.010749 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:45.011511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:45.011978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:45.092343 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-068175ec-87af-42f8-a4a4-48ecdd9ef515 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092443 Jul 27 15:34:45.092999 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 371/755] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:34:44 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:45.963704 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:45.964497 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:45.970334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:45.976601 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:45.977152 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:45.978007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:45.978534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:46.122952 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:46.133403 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:46.134842 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:46.136237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ac874ba8-7060-4bc8-8368-7f7f0727e314 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1743 microversion: 2.20 time: 0.176763 Jul 27 15:34:46.136802 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 385/756] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:45 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:46.309203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:46.309970 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=10 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:46.314810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-75f076e5-719e-4ee1-b732-e5c9dddd6f74 req-4ca03a07-179e-4855-bce5-7aaa999f2da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "601af892-ad4b-4797-8590-70c82bc772c3", "tag": "310d1b53-872f-4fbc-8c36-00e4731ac228"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:46.325917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-75f076e5-719e-4ee1-b732-e5c9dddd6f74 req-4ca03a07-179e-4855-bce5-7aaa999f2da7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:46.326352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-75f076e5-719e-4ee1-b732-e5c9dddd6f74 req-4ca03a07-179e-4855-bce5-7aaa999f2da7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:46.340585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-75f076e5-719e-4ee1-b732-e5c9dddd6f74 req-4ca03a07-179e-4855-bce5-7aaa999f2da7 service nova] Creating event network-changed:310d1b53-872f-4fbc-8c36-00e4731ac228 for instance 601af892-ad4b-4797-8590-70c82bc772c3 on hv-cinder-84131 Jul 27 15:34:46.345462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-75f076e5-719e-4ee1-b732-e5c9dddd6f74 req-4ca03a07-179e-4855-bce5-7aaa999f2da7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036908 Jul 27 15:34:46.346503 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 372/757] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:47.160338 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:47.161180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:47.168349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:47.168795 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:47.169574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:47.170017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:47.340959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:47.349923 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:47.351591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:47.353140 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-884e49e6-3a8e-4bea-bde2-16c2368c2fd3 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1743 microversion: 2.20 time: 0.197014 Jul 27 15:34:47.353710 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 386/758] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:47 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:47.654689 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-3dfbebf8-953b-45bc-8a13-7e410723811d req-c8f1f173-5300-4416-a7a6-f37dfae241c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "name": "network-vif-plugged", "status": "completed", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:47.672565 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3dfbebf8-953b-45bc-8a13-7e410723811d req-c8f1f173-5300-4416-a7a6-f37dfae241c1 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:47.673332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3dfbebf8-953b-45bc-8a13-7e410723811d req-c8f1f173-5300-4416-a7a6-f37dfae241c1 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:47.694894 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-3dfbebf8-953b-45bc-8a13-7e410723811d req-c8f1f173-5300-4416-a7a6-f37dfae241c1 service nova] Creating event network-vif-plugged:bd875b01-1fa3-46df-b071-0151f1189b66 for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a on hv-cinder-84131 Jul 27 15:34:47.703082 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-3dfbebf8-953b-45bc-8a13-7e410723811d req-c8f1f173-5300-4416-a7a6-f37dfae241c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052739 Jul 27 15:34:47.704485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 373/759] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:48.381393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:48.382095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:48.391163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:48.391613 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:48.392429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:48.393124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:48.583765 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:48.595173 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:48.596819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:48.598205 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2ba6a1c5-3026-4b0d-98e8-e2d84c238890 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.221792 Jul 27 15:34:48.599696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 387/760] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:48 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:49.631972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:49.633313 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:49.640325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:49.641116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:49.641982 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:49.642622 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:49.825660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:49.836284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:49.837837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:49.839468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-785e1765-c8cf-4031-8aae-2bb08a955d5c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.215849 Jul 27 15:34:49.840201 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 374/761] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:49 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:50.863944 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:50.864599 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:50.871597 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:50.872073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:50.872992 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:50.873426 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:51.048290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:51.057111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:51.058620 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:51.059784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-841ab7b9-6882-48f5-8311-e91c98374b2e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.199889 Jul 27 15:34:51.060858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 388/762] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:50 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:52.083597 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:52.084884 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:52.092211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:52.092211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:52.093023 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:52.093634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:52.270250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:52.281097 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:52.282929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:52.284202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a50e838a-d873-4087-a948-956c9488f21c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.205028 Jul 27 15:34:52.297251 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 375/763] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:52 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:53.310359 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:53.311448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:53.318564 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:53.319056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:53.319859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:53.320330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:53.503182 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:53.514715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:53.516274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:53.517452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9d6f29eb-3ee7-4596-a9ec-e1f4be7af2fb tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.211924 Jul 27 15:34:53.518010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 389/764] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:53 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:54.550065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:54.550917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:54.559709 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:54.560207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:54.560978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:54.561677 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:54.737363 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:54.749432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:54.751475 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:54.753244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fc084349-74ed-44de-8f42-007fd3264ee7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.207633 Jul 27 15:34:54.754327 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 376/765] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:54 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:55.779318 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:55.780051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:55.788073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:55.788515 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:55.789289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:55.789715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:55.954849 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:55.963653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:55.965188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:55.966574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4f16dfa4-b02b-411e-8e45-34e14fba0533 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.191170 Jul 27 15:34:55.967431 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 390/766] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:55 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:56.991330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:56.995330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:56.999497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:57.000065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:57.000907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:57.001414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:57.156913 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:57.165970 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:57.167668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:57.169026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6dfaa4d8-2239-4a5d-87d8-04c67f8709fa tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1738 microversion: 2.20 time: 0.182553 Jul 27 15:34:57.169586 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 377/767] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:56 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:58.193360 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:58.193973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:58.201088 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:58.202523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:58.203316 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:58.203752 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:58.342668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:58.350838 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:58.352378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:58.353550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f888e8c6-0e82-4c32-9142-a1e899dc5162 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1720 microversion: 2.20 time: 0.164396 Jul 27 15:34:58.354472 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 391/768] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:58 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:34:59.376746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:59.377350 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:34:59.384576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:59.385034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:59.385808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:34:59.386244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:34:59.517520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:59.525501 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:59.526988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:59.528190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb6ef8d6-a68c-4697-ab82-1ad05172f0e2 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1720 microversion: 2.20 time: 0.155365 Jul 27 15:34:59.528748 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 378/769] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:34:59 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:00.551353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:00.551986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:00.558798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:00.559250 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:00.560098 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:00.560509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:00.702986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:00.712721 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:00.714406 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:00.715614 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3298f1dc-7e37-4905-afbe-e190c059d3bd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1723 microversion: 2.20 time: 0.168386 Jul 27 15:35:00.716206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 392/770] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:00 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:00.739086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3f6fab6-dbd6-435d-a05a-f0d901038082"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:00.741481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:00.749682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:00.750135 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:00.750995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:00.751438 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:00.940047 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:01.036682 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-107d6699-0139-48bd-8324-e26523b05690 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301852 Jul 27 15:35:01.037303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 379/771] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Jul 27 15:35:00 2022] POST /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:35:01.162057 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:01.162540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:01.168832 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.169283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.170047 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.170480 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.406715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:01.418939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-01db00a9-2f6b-47a6-874f-95fe3c5feb42 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-volume_attachments/b3f6fab6-dbd6-435d-a05a-f0d901038082" status: 202 len: 0 microversion: 2.20 time: 0.259638 Jul 27 15:35:01.418939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 393/772] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Jul 27 15:35:01 2022] DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-volume_attachments/b3f6fab6-dbd6-435d-a05a-f0d901038082 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:35:01.478428 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:01.479035 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:01.485266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.485785 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.486545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.486962 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.530954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117870) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 15:35:01.609606 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cf585e2c-4405-4a86-86f0-0d4f013c54c6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "POST /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/action" status: 202 len: 0 microversion: 2.20 time: 0.135064 Jul 27 15:35:01.616117 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 380/773] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Jul 27 15:35:01 2022] POST /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:35:01.624015 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:01.625033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:01.637103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.637870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.639372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.640111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.700584 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-52923e82-cc20-40b0-afd3-6861cb6012bd req-a943244a-bd23-4c2d-9f4d-4c54270dca00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "name": "network-vif-unplugged", "status": "completed", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:01.728596 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-52923e82-cc20-40b0-afd3-6861cb6012bd req-a943244a-bd23-4c2d-9f4d-4c54270dca00 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:01.729284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-52923e82-cc20-40b0-afd3-6861cb6012bd req-a943244a-bd23-4c2d-9f4d-4c54270dca00 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:01.744773 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.compute.server_external_events [req-52923e82-cc20-40b0-afd3-6861cb6012bd req-a943244a-bd23-4c2d-9f4d-4c54270dca00 service nova] Unable to find a host for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a. Dropping event network-vif-unplugged {{(pid=117870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 15:35:01.746482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-52923e82-cc20-40b0-afd3-6861cb6012bd req-a943244a-bd23-4c2d-9f4d-4c54270dca00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061588 Jul 27 15:35:01.747382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 381/774] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 27 15:35:01.818340 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:01.826536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:01.828200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:01.829410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5f62a008-69dc-48ec-a5d4-38746f66103e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1671 microversion: 2.20 time: 0.212965 Jul 27 15:35:01.829981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 394/775] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:01 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1671 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:02.854643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:02.855342 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:02.862512 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:02.862958 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:02.864429 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:02.864861 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:03.018070 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:03.026726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:03.028272 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:03.029423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7cf3495d-22a6-46a6-9f71-6b5dcc227dc8 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.178968 Jul 27 15:35:03.029972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 382/776] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:02 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:04.053331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:04.053944 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:04.060668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:04.061647 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:04.062132 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:04.062590 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:04.289739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:04.308175 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:04.314176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:04.318036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1c8ef93f-ecd9-4524-9260-c15c9776b63c tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.269429 Jul 27 15:35:04.330249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 395/777] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:04 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:05.351073 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:05.352047 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:05.354745 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:05.360855 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:05.361305 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:05.362080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:05.362517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:05.513005 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:05.521518 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:05.523030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:05.524222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fd9f3380-9caa-4677-b828-633b5f8804e6 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.178266 Jul 27 15:35:05.524786 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 383/778] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:05 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:06.548851 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:06.550157 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:06.557191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=46 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:06.558748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:06.559397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:06.560440 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:06.561124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:06.727689 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:06.740846 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:06.743099 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:06.744492 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f1439e6c-402f-4198-8f45-1ff1a3612363 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.199732 Jul 27 15:35:06.745066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 396/779] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:06 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:07.774204 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:07.774912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:07.782262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:07.782710 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:07.783530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:07.783993 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:07.960010 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:07.976086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:07.977970 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:07.979288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7ac3e7d1-998d-4bf5-b28c-c9c3064e11b5 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.210643 Jul 27 15:35:07.983899 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 384/780] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:07 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:09.013298 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:09.014265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:09.021057 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:09.021510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:09.022291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:09.022779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:09.183217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:09.192184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:09.193707 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:09.194890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-26eebfd9-2611-4cb7-8cfb-6746e25b9df9 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.185546 Jul 27 15:35:09.195850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 397/781] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:09 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:10.221269 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:10.221963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:10.237660 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:10.238311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:10.239207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:10.239715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:10.448701 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:10.459014 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:10.460656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:10.461986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-002ee845-2c5f-4e53-a775-3f6c7cbd1384 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.244878 Jul 27 15:35:10.462541 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 385/782] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:10 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:11.492723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:11.495371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:11.506333 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:11.506964 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:11.507987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:11.508754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:11.678076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:11.689716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:11.691218 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:11.692428 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fe466b04-7df5-41be-9e2c-c564f455c014 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.208207 Jul 27 15:35:11.693178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 398/783] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:11 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:12.716419 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:12.717124 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:12.725266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:12.725718 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:12.726495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:12.726928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:12.876104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:12.886119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:12.887897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:12.889359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-03a04ded-2b67-4182-b841-99b01e2f03e7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.176805 Jul 27 15:35:12.889931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 386/784] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:12 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:13.917092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:13.917944 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:13.924956 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:13.925405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:13.926408 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:13.926875 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:14.070163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:14.078799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:14.080330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:14.081509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-adcb8e96-a3e8-46f0-8c46-a5977ddb8425 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.169088 Jul 27 15:35:14.082081 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 399/785] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:13 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:15.027562 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:15.028479 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:15.039646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:15.040150 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:15.040918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:15.041356 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:15.068703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9717a2e5-883e-42cb-898b-b98501a77ecf tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/ips" status: 200 len: 146 microversion: 2.1 time: 0.046590 Jul 27 15:35:15.069352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 387/786] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:35:15 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:15.105529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:15.106179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:15.113357 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:15.113811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:15.114589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:15.115550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:15.288179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:15.296746 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:15.298276 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:15.299459 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9796fe68-b687-4fad-ace9-4d35da7bb5e1 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.198409 Jul 27 15:35:15.300079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 400/787] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:15 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:16.324082 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:16.324671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:16.331319 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:16.331770 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:16.332591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:16.333032 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:16.462150 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "680aaa61-7c3d-4309-b93a-f832db65d2de"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:16.464685 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:16.471365 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:16.471818 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:16.472636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:16.473077 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:16.492903 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:16.501407 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:16.503712 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:16.504917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1523b1eb-f763-459d-b09b-e51efb2d6405 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.185092 Jul 27 15:35:16.505990 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 388/788] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:16 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:16.723471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5b47b16e-4aad-4786-b820-81fd236addc2 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265718 Jul 27 15:35:16.724176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 401/789] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:35:16 2022] POST /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:35:17.528517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:17.529081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:17.535681 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:17.536153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:17.537494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:17.537926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:17.671463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:17.680522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:17.682011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:17.683170 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-67a35402-5c59-498f-92cb-a157e50ae35b tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.158726 Jul 27 15:35:17.683813 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 389/790] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:17 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:17.831715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-45e422cd-1163-41d2-9969-9c15a624c328 req-c2e1d56d-1ba3-4521-b461-7eea9c566c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "name": "network-vif-plugged", "status": "completed", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:17.852312 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-45e422cd-1163-41d2-9969-9c15a624c328 req-c2e1d56d-1ba3-4521-b461-7eea9c566c49 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:17.852957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-45e422cd-1163-41d2-9969-9c15a624c328 req-c2e1d56d-1ba3-4521-b461-7eea9c566c49 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:17.868176 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-45e422cd-1163-41d2-9969-9c15a624c328 req-c2e1d56d-1ba3-4521-b461-7eea9c566c49 service nova] Creating event network-vif-plugged:bd875b01-1fa3-46df-b071-0151f1189b66 for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a on hv-cinder-84131 Jul 27 15:35:17.873678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-45e422cd-1163-41d2-9969-9c15a624c328 req-c2e1d56d-1ba3-4521-b461-7eea9c566c49 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046150 Jul 27 15:35:17.874354 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 402/791] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:18.706663 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:18.707275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:18.714412 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:18.714851 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:18.715612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:18.716142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:18.847116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:18.855793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:18.857326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:18.858496 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f12db9b7-9ccb-460e-b4b3-53ce9c96092f tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.155760 Jul 27 15:35:18.859062 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 390/792] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:18 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:19.885520 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:19.886214 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:19.892750 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:19.893201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:19.893967 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:19.894399 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:20.301818 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:20.309856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:20.311629 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:20.312817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-903d3f91-f3aa-44ab-b189-b35762267a36 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1729 microversion: 2.20 time: 0.432685 Jul 27 15:35:20.313376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 403/793] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:19 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1729 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:21.334672 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:21.335261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:21.342176 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:21.342619 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:21.343377 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:21.343801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:21.488877 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:21.497673 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:21.499179 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:21.500373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4016ad12-55fb-4be9-8523-cddeb2f4f2ec tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1716 microversion: 2.20 time: 0.169645 Jul 27 15:35:21.500927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 391/794] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:35:21 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:35:23.288861 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:23.291143 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:23.298199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:23.298650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:23.299432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:23.299901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:23.333014 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-774f5256-cf5f-4df1-8274-b27ffb54b6d6 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048084 Jul 27 15:35:23.333603 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 404/795] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:35:23 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:35:23.344465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:23.345324 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:23.352528 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:23.352977 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:23.353752 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:23.354181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:23.386650 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3b6c3b5e-7345-482c-8e98-0ac09fc4452d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/680aaa61-7c3d-4309-b93a-f832db65d2de" status: 200 len: 194 microversion: 2.1 time: 0.046156 Jul 27 15:35:23.387262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 392/796] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Jul 27 15:35:23 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/680aaa61-7c3d-4309-b93a-f832db65d2de => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:24.743421 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60e01174-cb49-49d5-850c-e5b8be59a667"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:24.746912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:24.758127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:24.758586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:24.759415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:24.759918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:25.013174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-877d543f-7fc5-4c59-8051-dc7b4e147b9b tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "POST /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275662 Jul 27 15:35:25.013701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 405/797] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:35:24 2022] POST /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:29.863532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:29.864387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:29.871194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:29.871634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:29.872429 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:29.872850 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:29.898757 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a2ed9514-e12d-4862-a1d2-01bea5b42c75 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/ips" status: 200 len: 151 microversion: 2.1 time: 0.039056 Jul 27 15:35:29.899325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 393/798] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:35:29 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:31.278496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b4b1af-1a3a-47cc-b8f9-e31d02184810"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:31.280942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:31.287727 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:31.288200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:31.288971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:31.289412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:31.642288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=85,nova_cell1:INSERT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:31.757727 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-35531934-2d0d-4cec-a86a-5ef0dad4c90d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484002 Jul 27 15:35:31.758711 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 406/799] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:35:31 2022] POST /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:32.558429 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:32.560987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:32.568206 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:32.568650 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:32.569412 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:32.569856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:32.572397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:32.605769 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ac03ce7d-cbcb-4f91-bb40-bcc82e7e5e1f tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051200 Jul 27 15:35:32.606344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 394/800] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:35:32 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:32.750330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:32.750856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:32.757564 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:32.758007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:32.758784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:32.759210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:32.794650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7b6680c9-0122-4848-9b9a-2907bea5109e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/680aaa61-7c3d-4309-b93a-f832db65d2de" status: 200 len: 194 microversion: 2.1 time: 0.049104 Jul 27 15:35:32.795245 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 407/801] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Jul 27 15:35:32 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/680aaa61-7c3d-4309-b93a-f832db65d2de => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:32.806007 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:32.806486 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:32.812825 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:32.813267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:32.814024 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:32.814453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:32.898031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lazy-loading 'services' on Instance uuid 06c197fd-bf3d-4589-86ed-e771f386c806 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:35:32.977774 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c5d76db-3dfc-4320-9207-aa7993845483 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/680aaa61-7c3d-4309-b93a-f832db65d2de" status: 202 len: 0 microversion: 2.1 time: 0.176016 Jul 27 15:35:32.978389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 395/802] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:35:32 2022] DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/680aaa61-7c3d-4309-b93a-f832db65d2de => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:35:39.347341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1a1b9a0f-bec8-44d2-88c4-451a05f740e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: .version_select at 0x7f9fe022fd30>, body: {"keypair": {"name": "tempest-keypair-248576442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrP6nD1zcx0LYD1TUpAqWaco4v4ax2djVyHM+mjabGBlBeCqkxFua8dOX3Ycqch16mXnkBHOOHZTo/lmY2BjkywxYMGzr+ISP5ht3BjMmAnc8Keglxwqw3+FYSZL88DQ=="}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:39.353705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=24 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:39.366826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-1a1b9a0f-bec8-44d2-88c4-451a05f740e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:35:39.372377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-1a1b9a0f-bec8-44d2-88c4-451a05f740e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:35:39.396205 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1a1b9a0f-bec8-44d2-88c4-451a05f740e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052644 Jul 27 15:35:39.396809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 408/803] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:35:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:39.399036 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:39.399614 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:39.401703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=26 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:39.407919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:39.408387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:39.409207 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:39.409834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:39.442860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-30c0d935-ee82-46e6-8642-74ce948a65bc tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/60e01174-cb49-49d5-850c-e5b8be59a667" status: 200 len: 194 microversion: 2.1 time: 0.049590 Jul 27 15:35:39.443753 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 396/804] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Jul 27 15:35:39 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/60e01174-cb49-49d5-850c-e5b8be59a667 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:35:39.455309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:39.455805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:39.462201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:39.462753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:39.463712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:39.464228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:39.565745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lazy-loading 'services' on Instance uuid 06c197fd-bf3d-4589-86ed-e771f386c806 {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:35:39.654477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-444be516-5350-4571-9341-f19e4d970be4 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/60e01174-cb49-49d5-850c-e5b8be59a667" status: 202 len: 0 microversion: 2.1 time: 0.203103 Jul 27 15:35:39.659641 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 409/805] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:35:39 2022] DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments/60e01174-cb49-49d5-850c-e5b8be59a667 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:35:40.865942 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:40.868945 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:40.877428 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:40.877878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:40.878733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:40.880177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:40.914936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-84ad8762-ff06-4612-a9f7-4c6f9172bf24 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053329 Jul 27 15:35:40.915726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 397/806] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:35:40 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:35:40.953445 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-979255907", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb"}], "security_groups": [{"name": "tempest-securitygroup--1461891211"}], "key_name": "tempest-keypair-248576442", "user_data": "}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:41.057749 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:41.060330 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:41.069011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.069824 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.070937 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.071612 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.096787 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] validate_networks() for [('a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:35:41.106838 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ff3fb837-fc64-4009-800a-3a983ec88d87 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053073 Jul 27 15:35:41.107820 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 398/807] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:35:41 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:35:41.190808 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:41.192254 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:41.199711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.200573 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.201878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.202393 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.242460 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:35:41.360695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5443aa6c-562d-4f41-8f58-1cf92a69acb5 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 204 len: 0 microversion: 2.1 time: 0.173492 Jul 27 15:35:41.368804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 399/808] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:35:41 2022] DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:35:41.374589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:41.375399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:41.383129 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.383652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.384569 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.385072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.551535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:41.563650 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-04929620-80f2-4ffa-99bb-61c45ae30ea1 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1673 microversion: 2.1 time: 0.193287 Jul 27 15:35:41.564622 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 400/809] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:41 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:41.699197 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:35:41.699890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:35:41.700735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:35:41.700911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:35:41.701353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:35:41.712425 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.712878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.713668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:41.714096 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:41.732021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:35:41.736284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:35:41.747862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:35:41.750264 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:35:41.799612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-84adc242-bf90-4b0c-800a-a60f20540752 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.851518 Jul 27 15:35:41.800374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 410/810] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:35:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:35:41.811741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c23ba54b-798d-4eef-a769-8b9f230ae42e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:41.812389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c23ba54b-798d-4eef-a769-8b9f230ae42e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:41.870391 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c23ba54b-798d-4eef-a769-8b9f230ae42e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:41.878077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c23ba54b-798d-4eef-a769-8b9f230ae42e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1240 microversion: 2.1 time: 0.070535 Jul 27 15:35:41.878742 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 401/811] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:41 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:42.587312 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:42.587957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:42.594249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:42.594693 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:42.595456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:42.595917 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:42.730452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:42.738036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5b5c5568-dd8b-4c22-a574-5c494ff83732 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1673 microversion: 2.1 time: 0.155245 Jul 27 15:35:42.739241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 411/812] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:42 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:42.900485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:42.901104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:42.908469 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:42.908923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:42.909692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:42.910166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:42.974872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:42.982394 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-787736b8-4444-403c-ab84-60d8bfcdde06 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1244 microversion: 2.1 time: 0.085772 Jul 27 15:35:42.982963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 402/813] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:42 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:43.760018 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:43.760544 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:43.767397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:43.767859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:43.768632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:43.769068 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:43.911794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:43.919379 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5b49009e-bc04-4d86-aaa2-38b2cc62ffce tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1673 microversion: 2.1 time: 0.163372 Jul 27 15:35:43.919993 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 412/814] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:43 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:44.002712 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:44.003315 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:44.009957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:44.010455 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:44.011158 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:44.011598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:44.073267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:44.080766 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f4e5e3b7-ca9d-476f-9ed5-1cd773f34ced tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1244 microversion: 2.1 time: 0.081943 Jul 27 15:35:44.081340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 403/815] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:43 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:44.942155 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:44.942870 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:44.949954 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:44.950169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:44.950881 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:44.951317 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:45.102431 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:45.103199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:45.103649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:45.109701 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:45.110153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:45.110920 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:45.111352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:45.111531 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5941ce2e-3ee9-4dcb-8ee0-b7ea1713ae16 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1673 microversion: 2.1 time: 0.173672 Jul 27 15:35:45.112161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 413/816] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:44 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:45.180181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:45.188153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c36493a5-316a-467b-a0c9-f56366e40c35 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1236 microversion: 2.1 time: 0.089759 Jul 27 15:35:45.188723 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 404/817] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:45 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:46.135615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:46.136506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:46.143351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:46.144214 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:46.145765 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:46.146292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:46.210594 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:46.211211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:46.216164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b027a2c8dd4459b1309faab28f3d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddbf2261d1f42d0a41aa921197fc181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:46.218042 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:46.218497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:46.219270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:46.219698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:46.236102 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0756f78d-3814-4424-b61e-e464510e861e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 200 len: 1605 microversion: 2.1 time: 0.093997 Jul 27 15:35:46.236102 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 414/818] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:46 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 1605 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:46.404593 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-0eb8fa26-a9d0-4834-aa3c-435ed3e2286c req-b538e7de-f954-4871-8cab-18cf87228c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c197fd-bf3d-4589-86ed-e771f386c806", "name": "network-vif-deleted", "tag": "a0089b98-aa8d-48fa-a318-0cab30dccdb8"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:46.406628 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:46.419465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-0eb8fa26-a9d0-4834-aa3c-435ed3e2286c req-b538e7de-f954-4871-8cab-18cf87228c6a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:46.420378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-0eb8fa26-a9d0-4834-aa3c-435ed3e2286c req-b538e7de-f954-4871-8cab-18cf87228c6a service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:46.426199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-57556c7d-fc88-4489-976d-732cd23c0b2e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1298 microversion: 2.1 time: 0.218184 Jul 27 15:35:46.432291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 405/819] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:46 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:46.438595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-0eb8fa26-a9d0-4834-aa3c-435ed3e2286c req-b538e7de-f954-4871-8cab-18cf87228c6a service nova] Creating event network-vif-deleted:a0089b98-aa8d-48fa-a318-0cab30dccdb8 for instance 06c197fd-bf3d-4589-86ed-e771f386c806 on hv-cinder-84131 Jul 27 15:35:46.446497 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-0eb8fa26-a9d0-4834-aa3c-435ed3e2286c req-b538e7de-f954-4871-8cab-18cf87228c6a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046530 Jul 27 15:35:46.447867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 415/820] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:35:47.247643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:47.248218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:47.263943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:47.264409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:47.265462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:47.265630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:47.284142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] HTTP exception thrown: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Request method failure captured: Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 HTTP/1.1 Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmrfWRHB8cBN4OCMBGUx_pWc5d08jNMvBgzV-NY-QaEXCHbtHYGVZsYHFP69O1r68IeJW1vtuj-eWWpQR6nXGrfqe1rKAJFABpCNyyfHc7Fi9v4xz5LAtpE2Twqls4m1FWVoodPJeJYBptL3kUFNT1b2cIU_X75A67FyWhz_ahjgGU Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:35:47.284399 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fddbf2261d1f42d0a41aa921197fc181", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: a2b027a2c8dd4459b1309faab28f3d4b Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:47.286044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '06c197fd-bf3d-4589-86ed-e771f386c806'} Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:35:47.286891 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:47.288358 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:47.289517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Returning 404 to user: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:35:47.289517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f2a1ed3a-b1a7-4877-bcf0-183c340c5983 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 404 len: 111 microversion: 2.1 time: 0.042816 Jul 27 15:35:47.289517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 406/821] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:47 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:35:47.299376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d4941785-63d2-418b-9fa8-7f272bf07e14 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '.version_select at 0x7f9fe022ff70>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:47.337171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d4941785-63d2-418b-9fa8-7f272bf07e14 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448920325" status: 202 len: 0 microversion: 2.1 time: 0.045969 Jul 27 15:35:47.338359 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 416/822] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Jul 27 15:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448920325 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:35:47.459994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:47.461127 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:47.471338 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:47.471795 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:47.473093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:47.473875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:47.716346 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:47.732483 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-95afb031-49b0-4c76-bb91-212a0d14a994 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.277984 Jul 27 15:35:47.739549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 407/823] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:47 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:47.966274 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-cdcece49-de3e-479b-b229-e11003a3bb2b req-cb1878a2-1533-4036-ab7c-c30dc7ff56b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc517287-de76-4a17-94aa-a47eb0588266", "tag": "a1da6a28-167f-49d0-b01c-8513acaf72d7"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:47.985748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-cdcece49-de3e-479b-b229-e11003a3bb2b req-cb1878a2-1533-4036-ab7c-c30dc7ff56b7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:47.986452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-cdcece49-de3e-479b-b229-e11003a3bb2b req-cb1878a2-1533-4036-ab7c-c30dc7ff56b7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:48.007130 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-cdcece49-de3e-479b-b229-e11003a3bb2b req-cb1878a2-1533-4036-ab7c-c30dc7ff56b7 service nova] Creating event network-changed:a1da6a28-167f-49d0-b01c-8513acaf72d7 for instance dc517287-de76-4a17-94aa-a47eb0588266 on hv-cinder-84131 Jul 27 15:35:48.014158 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-cdcece49-de3e-479b-b229-e11003a3bb2b req-cb1878a2-1533-4036-ab7c-c30dc7ff56b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051376 Jul 27 15:35:48.015204 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 417/824] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:48.761045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:48.761678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:48.768329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:48.768779 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:48.770081 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:48.770511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:48.913202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:48.921206 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-255b2095-36b2-4a48-b260-7b1c29271514 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.164957 Jul 27 15:35:48.921775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 408/825] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:48 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:49.609474 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1818804587", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1638862773", "security_groups": [{"name": "tempest-secgroup-smoke-1358726124"}], "block_device_mapping_v2": [{"uuid": "0e6b9966-3056-46dd-9e29-1c973be35ac8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03d84d0-4188-403f-a4d9-b8ed9de732b3"}]}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:49.835303 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] validate_networks() for [('a03d84d0-4188-403f-a4d9-b8ed9de732b3', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:35:49.945680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:49.946285 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:49.953076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:49.953515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:49.954532 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:49.955055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.145834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:50.157661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e173102a-58e3-4464-bd0e-0acf46e2cf8e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.217700 Jul 27 15:35:50.159294 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 409/826] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:49 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:50.671762 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:35:50.672536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:35:50.673378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:35:50.674322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:35:50.675052 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:35:50.688623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:50.689373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.690659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:50.691945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.718868 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for project d3fd186ce4ca4030b191309f43d43baa. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:35:50.725044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Getting quotas for user d737eac8ae0343df9ace919d75596800 and project d3fd186ce4ca4030b191309f43d43baa. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:35:50.796009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:35:50.798182 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e6b9966-3056-46dd-9e29-1c973be35ac8',volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:35:50.801507 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:50.802018 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:50.808462 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:50.808912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.810084 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:50.810523 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.814726 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:50.826722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] HTTP exception thrown: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Request method failure captured: Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 HTTP/1.1 Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmrfWRHB8cBN4OCMBGUx_pWc5d08jNMvBgzV-NY-QaEXCHbtHYGVZsYHFP69O1r68IeJW1vtuj-eWWpQR6nXGrfqe1rKAJFABpCNyyfHc7Fi9v4xz5LAtpE2Twqls4m1FWVoodPJeJYBptL3kUFNT1b2cIU_X75A67FyWhz_ahjgGU Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:35:50.829219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fddbf2261d1f42d0a41aa921197fc181", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: a2b027a2c8dd4459b1309faab28f3d4b Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.830542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '06c197fd-bf3d-4589-86ed-e771f386c806'} Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:35:50.831238 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.833104 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.835499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Returning 404 to user: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:35:50.835499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-719b26ba-3f86-4c7e-9b2b-e876ca7b586d tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 404 len: 111 microversion: 2.1 time: 0.033060 Jul 27 15:35:50.835499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 410/827] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:35:50 2022] DELETE /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:35:50.841214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:50.841919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: 06c197fd-bf3d-4589-86ed-e771f386c806] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:50.850893 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:50.851448 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.852098 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:50.852533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:50.881929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] HTTP exception thrown: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Request method failure captured: Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 HTTP/1.1 Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmrfWRHB8cBN4OCMBGUx_pWc5d08jNMvBgzV-NY-QaEXCHbtHYGVZsYHFP69O1r68IeJW1vtuj-eWWpQR6nXGrfqe1rKAJFABpCNyyfHc7Fi9v4xz5LAtpE2Twqls4m1FWVoodPJeJYBptL3kUFNT1b2cIU_X75A67FyWhz_ahjgGU Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:35:50.883359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fddbf2261d1f42d0a41aa921197fc181", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: a2b027a2c8dd4459b1309faab28f3d4b Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.885404 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '06c197fd-bf3d-4589-86ed-e771f386c806'} Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:35:50.886488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. Jul 27 15:35:50.888165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:35:50.890148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Returning 404 to user: Instance 06c197fd-bf3d-4589-86ed-e771f386c806 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:35:50.890148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e013de33-e5e2-4dce-a2fa-ce0ed5519585 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806" status: 404 len: 111 microversion: 2.1 time: 0.048188 Jul 27 15:35:50.890148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 411/828] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:50 2022] GET /compute/v2.1/servers/06c197fd-bf3d-4589-86ed-e771f386c806 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:35:50.952535 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b9fd8ec2-01da-4f27-aa26-1a40154096fb tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.354585 Jul 27 15:35:50.956042 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 418/829] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:35:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:35:50.967041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8177ccef-d8b1-438a-ae72-8754ad7d2a03 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:50.967670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8177ccef-d8b1-438a-ae72-8754ad7d2a03 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:51.037921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8177ccef-d8b1-438a-ae72-8754ad7d2a03 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:51.045183 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8177ccef-d8b1-438a-ae72-8754ad7d2a03 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1095 microversion: 2.1 time: 0.084218 Jul 27 15:35:51.055115 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 412/830] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:50 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:51.182372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:51.182994 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:51.191778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:51.192275 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:51.193058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:51.193495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:51.339055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:51.347630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ef9bd2a3-c436-4791-89e1-8114ab9b794b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.169437 Jul 27 15:35:51.348237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 419/831] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:51 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:52.069454 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:52.070373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:52.089649 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.092266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.094996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.096166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.106294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:52.106294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:52.124002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.124457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.125258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.125701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.164451 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] HTTP exception thrown: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Request method failure captured: Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 HTTP/1.1 Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmrfWRHB8cBN4OCMBGUx_pWc5d08jNMvBgzV-NY-QaEXCHbtHYGVZsYHFP69O1r68IeJW1vtuj-eWWpQR6nXGrfqe1rKAJFABpCNyyfHc7Fi9v4xz5LAtpE2Twqls4m1FWVoodPJeJYBptL3kUFNT1b2cIU_X75A67FyWhz_ahjgGU Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:35:52.166611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fddbf2261d1f42d0a41aa921197fc181", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: a2b027a2c8dd4459b1309faab28f3d4b Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.169962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'ba023b6d-f35a-4213-979f-652a4c79acd9'} Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:35:52.171819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.174016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.175509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Returning 404 to user: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:35:52.175509 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9134a672-550a-44e4-bb01-089d3561afd0 tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 404 len: 111 microversion: 2.1 time: 0.069415 Jul 27 15:35:52.179200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 420/832] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:35:52 2022] DELETE /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:35:52.191742 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:52.193833 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] [instance: ba023b6d-f35a-4213-979f-652a4c79acd9] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:52.204312 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.204909 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.205690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.206123 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.222489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] HTTP exception thrown: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Request method failure captured: Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 HTTP/1.1 Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmrfWRHB8cBN4OCMBGUx_pWc5d08jNMvBgzV-NY-QaEXCHbtHYGVZsYHFP69O1r68IeJW1vtuj-eWWpQR6nXGrfqe1rKAJFABpCNyyfHc7Fi9v4xz5LAtpE2Twqls4m1FWVoodPJeJYBptL3kUFNT1b2cIU_X75A67FyWhz_ahjgGU Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:35:52.224265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fddbf2261d1f42d0a41aa921197fc181", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fddbf2261d1f42d0a41aa921197fc181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: fddbf2261d1f42d0a41aa921197fc181 Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-858650457 Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: a2b027a2c8dd4459b1309faab28f3d4b Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeTestJSON-858650457-project Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.225862 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'ba023b6d-f35a-4213-979f-652a4c79acd9'} Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:35:52.227533 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. Jul 27 15:35:52.232309 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:35:52.233389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] Returning 404 to user: Instance ba023b6d-f35a-4213-979f-652a4c79acd9 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:35:52.233389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-caed9d48-3f90-4a8f-bd61-250fbbcbe84e tempest-AttachVolumeTestJSON-858650457 tempest-AttachVolumeTestJSON-858650457-project] 10.222.0.36 "GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9" status: 404 len: 111 microversion: 2.1 time: 0.045416 Jul 27 15:35:52.233389 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 421/833] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:52 2022] GET /compute/v2.1/servers/ba023b6d-f35a-4213-979f-652a4c79acd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:35:52.250544 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:52.262236 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7d45a4c2-70ec-4070-9620-7bdded64817c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1201 microversion: 2.1 time: 0.197503 Jul 27 15:35:52.263812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 413/834] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:52 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1201 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:52.375457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:52.375457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:52.377726 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.381108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.381108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:52.381108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:52.752750 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:52.762967 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f873c4ea-dd7f-4231-8435-383e41c65674 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.396678 Jul 27 15:35:52.776028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 422/835] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:52 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:53.289496 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:53.290688 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:53.303107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:53.304053 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:53.305526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:53.306329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:53.395765 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:53.404218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e7b5c162-6be1-4204-a9fd-2c44915347bc tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1199 microversion: 2.1 time: 0.122878 Jul 27 15:35:53.404971 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 414/836] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:53 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:53.787547 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:53.788887 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:53.796306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:53.796704 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:53.797927 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:53.798326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:54.063867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-1e409cfc-6009-415d-a1db-918e98e16168 req-932a3544-de8d-4c70-aafd-8111b51a13b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc517287-de76-4a17-94aa-a47eb0588266", "name": "network-vif-plugged", "status": "completed", "tag": "a1da6a28-167f-49d0-b01c-8513acaf72d7"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:54.078406 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1e409cfc-6009-415d-a1db-918e98e16168 req-932a3544-de8d-4c70-aafd-8111b51a13b7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:54.080483 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1e409cfc-6009-415d-a1db-918e98e16168 req-932a3544-de8d-4c70-aafd-8111b51a13b7 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:54.093281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-1e409cfc-6009-415d-a1db-918e98e16168 req-932a3544-de8d-4c70-aafd-8111b51a13b7 service nova] Creating event network-vif-plugged:a1da6a28-167f-49d0-b01c-8513acaf72d7 for instance dc517287-de76-4a17-94aa-a47eb0588266 on hv-cinder-84131 Jul 27 15:35:54.100343 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-1e409cfc-6009-415d-a1db-918e98e16168 req-932a3544-de8d-4c70-aafd-8111b51a13b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040821 Jul 27 15:35:54.102089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 415/837] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:54.377946 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:54.388671 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8e2c39b3-c80d-496c-881b-9d3bf5617654 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.605448 Jul 27 15:35:54.389634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 423/838] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:53 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:54.428337 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:54.429338 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:54.437307 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:54.437763 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:54.438787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:54.439224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:54.661134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:54.678374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cfcfe434-8747-416c-acce-48258e764133 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.254046 Jul 27 15:35:54.678374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 416/839] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:54 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:55.399893 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-d6242638-4bdb-4a30-a415-ca2d431f9302 req-f337591f-ec0e-4ee5-8fd2-74affa6d93ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20304f5-8614-4b22-a414-e1c5d5a610e1", "tag": "a74c612d-f030-4677-ac76-2b3872c89434"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:55.419639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:55.420731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:55.422116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-d6242638-4bdb-4a30-a415-ca2d431f9302 req-f337591f-ec0e-4ee5-8fd2-74affa6d93ad service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:55.422683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-d6242638-4bdb-4a30-a415-ca2d431f9302 req-f337591f-ec0e-4ee5-8fd2-74affa6d93ad service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:55.430594 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:55.431936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:55.433526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:55.434578 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:55.444782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-d6242638-4bdb-4a30-a415-ca2d431f9302 req-f337591f-ec0e-4ee5-8fd2-74affa6d93ad service nova] Creating event network-changed:a74c612d-f030-4677-ac76-2b3872c89434 for instance c20304f5-8614-4b22-a414-e1c5d5a610e1 on hv-cinder-84131 Jul 27 15:35:55.455364 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-d6242638-4bdb-4a30-a415-ca2d431f9302 req-f337591f-ec0e-4ee5-8fd2-74affa6d93ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065639 Jul 27 15:35:55.456611 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 424/840] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:55.643556 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:55.658409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e18c40ae-ed62-44b9-81fb-1e1c232fc467 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1366 microversion: 2.1 time: 0.244920 Jul 27 15:35:55.660494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 417/841] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:55 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:55.708920 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:55.710225 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:55.718036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:55.718496 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:55.719332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:55.719961 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:55.943160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:55.962195 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c6b70449-0be8-4647-b9e5-8a374f88ce6e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.257611 Jul 27 15:35:55.974420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 425/842] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:55 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:56.683239 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:56.684047 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:56.691354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:56.692264 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:56.693320 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:56.693926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:56.983811 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:56.984488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:56.992249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:56.993010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:56.994165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:56.994806 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:57.141986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:57.151536 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c054e6e3-522c-47d7-a893-0b501efe8d82 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1556 microversion: 2.1 time: 0.472127 Jul 27 15:35:57.153021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 418/843] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:56 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1556 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:57.173589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:57.174702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:57.192624 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:57.193193 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:57.194288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:57.194989 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:57.283933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a8c884e4-ffdf-45fd-b901-4025bd4de38b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114734 Jul 27 15:35:57.285212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 419/844] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:35:57 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:35:57.620590 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:57.630127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7e33332f-e981-489e-9b79-be74c98ec08f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.650298 Jul 27 15:35:57.630719 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 426/845] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:56 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:35:58.342437 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b2a2cb1f-1cf4-4853-b7a8-04c54f38562f req-95536c6a-6e3c-4e93-8285-a351bceae899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc517287-de76-4a17-94aa-a47eb0588266", "tag": "a1da6a28-167f-49d0-b01c-8513acaf72d7"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:35:58.355960 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b2a2cb1f-1cf4-4853-b7a8-04c54f38562f req-95536c6a-6e3c-4e93-8285-a351bceae899 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:58.356829 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b2a2cb1f-1cf4-4853-b7a8-04c54f38562f req-95536c6a-6e3c-4e93-8285-a351bceae899 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:58.370398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-b2a2cb1f-1cf4-4853-b7a8-04c54f38562f req-95536c6a-6e3c-4e93-8285-a351bceae899 service nova] Creating event network-changed:a1da6a28-167f-49d0-b01c-8513acaf72d7 for instance dc517287-de76-4a17-94aa-a47eb0588266 on hv-cinder-84131 Jul 27 15:35:58.376840 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b2a2cb1f-1cf4-4853-b7a8-04c54f38562f req-95536c6a-6e3c-4e93-8285-a351bceae899 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037905 Jul 27 15:35:58.378086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 420/846] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:35:58.654873 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:58.655625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:35:58.667930 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:58.668393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:58.669277 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:35:58.669776 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:35:58.956466 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:35:58.970400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d3352d5f-916e-4dd4-9bd1-17f1f0121f08 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.320072 Jul 27 15:35:58.970992 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 427/847] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:58 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:35:59.994875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:35:59.995608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:00.001992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:00.002442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:00.003881 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:00.004320 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:00.213045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:00.221806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ff902630-c370-4108-8979-caf8c6ab3d9e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.231632 Jul 27 15:36:00.222651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 421/848] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:35:59 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:00.989060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:00.991507 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:00.994200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=4 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:00.994872 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=16 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:01.000654 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.001277 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.002061 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.002516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.017420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:01.036575 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f078667a-4c82-4b87-be85-1100282e8799 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053400 Jul 27 15:36:01.037330 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 428/849] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Jul 27 15:36:00 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:01.127543 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:01.128933 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:01.136262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:01.139211 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.139858 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.140799 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.141329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.170311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:36:01.246684 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:01.247936 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:01.253313 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f4503051-14d8-4d85-a59a-438a2d99294e tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 204 len: 0 microversion: 2.20 time: 0.130365 Jul 27 15:36:01.257177 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.257526 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 422/850] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Jul 27 15:36:01 2022] DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 15:36:01.259156 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.260569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.261041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.264776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:01.267113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:01.272950 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.273479 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.274323 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:01.278256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:01.425281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:01.438553 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:01.442572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:01.444099 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-566bd7a7-a5f4-4e54-80c1-128dc1e48208 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.184339 Jul 27 15:36:01.444834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 423/851] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:01 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:36:01.464265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:01.471819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-be153ce6-f4b9-4816-886f-1e85d63ab481 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.231571 Jul 27 15:36:01.472690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 429/852] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:01 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:02.468438 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:02.469116 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:02.476245 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:02.476691 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:02.477459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:02.477889 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:02.497607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:02.498631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:02.507488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:02.508064 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:02.509349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:02.510108 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:02.637339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:02.645340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:02.646829 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:02.648016 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d14fda16-41aa-406a-ab96-6cdcffbba9e0 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.183697 Jul 27 15:36:02.648579 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 424/853] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:02 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:36:02.748754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:02.762406 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-026d3c01-4dd0-4e79-87ea-ac2efa47ee6f tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.271268 Jul 27 15:36:02.763351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 430/854] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:02 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:36:03.675373 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:03.676172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:03.682758 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:03.683200 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:03.684256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:03.685140 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:03.788538 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:03.789289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:03.796418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:03.796793 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:03.797570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:03.798007 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:03.900642 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:03.914007 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:03.916768 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:03.919054 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f37d7347-3fd2-4d3c-bbb0-d9f86edcc942 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1722 microversion: 2.20 time: 0.251057 Jul 27 15:36:03.920613 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 425/855] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:03 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:36:04.101959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:04.112591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-af8fce61-e8dd-4a15-b7bb-0f2923b2c976 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.327722 Jul 27 15:36:04.113332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 431/856] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:03 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:36:04.586777 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-64e6f528-7c06-43c1-8d49-2abd1e418892 req-3f57d976-6f4a-4986-a321-d51f5e2523de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c0a14c-8873-4689-9e66-43ba0b7c934a", "name": "network-vif-deleted", "tag": "bd875b01-1fa3-46df-b071-0151f1189b66"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:04.598662 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-64e6f528-7c06-43c1-8d49-2abd1e418892 req-3f57d976-6f4a-4986-a321-d51f5e2523de service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:04.599286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-64e6f528-7c06-43c1-8d49-2abd1e418892 req-3f57d976-6f4a-4986-a321-d51f5e2523de service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:04.629856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-64e6f528-7c06-43c1-8d49-2abd1e418892 req-3f57d976-6f4a-4986-a321-d51f5e2523de service nova] Creating event network-vif-deleted:bd875b01-1fa3-46df-b071-0151f1189b66 for instance 27c0a14c-8873-4689-9e66-43ba0b7c934a on hv-cinder-84131 Jul 27 15:36:04.642284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-64e6f528-7c06-43c1-8d49-2abd1e418892 req-3f57d976-6f4a-4986-a321-d51f5e2523de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059249 Jul 27 15:36:04.644610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 426/857] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:04.947064 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:04.948370 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:04.959071 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:04.959526 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:04.960377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:04.960812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:04.998010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:04.998494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:04.999373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lazy-loading 'fault' on Instance uuid 27c0a14c-8873-4689-9e66-43ba0b7c934a {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:36:05.057769 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:05.069254 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:05.070970 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a964a003f8e4f1da603a13eb7f534ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddfdba8b75e643b485b2237ae070a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:05.072213 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f2e53cf4-ef1a-4df9-8ebc-6eba7f832fe7 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 200 len: 1370 microversion: 2.20 time: 0.130144 Jul 27 15:36:05.075994 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 432/858] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:04 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 1370 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:36:05.146504 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:05.147220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:05.154276 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:05.154971 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:05.155957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:05.156398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:05.333792 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:05.347994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5f6216d6-d62f-4c72-a2c7-81331f773712 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.205873 Jul 27 15:36:05.349057 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 427/859] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:05 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:06.097256 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:06.098139 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:06.104979 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:06.105427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:06.106226 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:06.106859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:06.121843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] HTTP exception thrown: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Request method failure captured: Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a HTTP/1.1 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmxJuol-OSo87paFWKy5Mj7hRP8EMPA5c7wVrZl9q3seXpIDejapcF2_5M6VtsporaMnNPdUxeSTsbsmi6ypf4Aq-wN8Km_WHLw71HRUxE6rF6qKgvJg3UJZnfQ8d6v7vTgZTWIjHeFat6cGGuv2HNf_YYO7COMMKUCmhMmUg6v6kk Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:36:06.123796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddfdba8b75e643b485b2237ae070a1b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 7a964a003f8e4f1da603a13eb7f534ca Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:06.125344 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '27c0a14c-8873-4689-9e66-43ba0b7c934a'} Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:06.126209 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:06.127407 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:06.130517 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Returning 404 to user: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:06.130517 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-026fdfcb-d686-454c-a8dc-6c3c3cc9291a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 404 len: 111 microversion: 2.20 time: 0.032023 Jul 27 15:36:06.130517 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 433/860] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:06 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:36:06.135534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f56b4e52-5d50-4b1f-ac73-895868a70902 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '.version_select at 0x7f9fd397caf0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:06.169908 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f56b4e52-5d50-4b1f-ac73-895868a70902 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170554821" status: 204 len: 0 microversion: 2.20 time: 0.038744 Jul 27 15:36:06.170610 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 428/861] 10.222.0.36 () {60 vars in 1259 bytes} [Wed Jul 27 15:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170554821 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 15:36:06.369398 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:06.370073 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:06.376844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:06.378210 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:06.379172 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:06.380253 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:06.613743 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:06.627740 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9754e675-ee3b-4c7f-af5f-193aa1a38a0e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.261186 Jul 27 15:36:06.642680 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 434/862] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:06 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:07.659199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:07.659804 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:07.667359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:07.667800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:07.668581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:07.669015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:07.805395 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:07.813427 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ac9e793b-69d9-491c-b7c5-12179bd43531 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.158621 Jul 27 15:36:07.813996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 429/863] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:07 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:08.091944 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-fdff018a-0e17-4cc5-b591-31dd7432dd25 req-462f5db1-68bc-4c1e-a489-37a09782a753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20304f5-8614-4b22-a414-e1c5d5a610e1", "name": "network-vif-plugged", "status": "completed", "tag": "a74c612d-f030-4677-ac76-2b3872c89434"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:08.102852 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:08.113837 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-fdff018a-0e17-4cc5-b591-31dd7432dd25 req-462f5db1-68bc-4c1e-a489-37a09782a753 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.114288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-fdff018a-0e17-4cc5-b591-31dd7432dd25 req-462f5db1-68bc-4c1e-a489-37a09782a753 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.138076 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-fdff018a-0e17-4cc5-b591-31dd7432dd25 req-462f5db1-68bc-4c1e-a489-37a09782a753 service nova] Creating event network-vif-plugged:a74c612d-f030-4677-ac76-2b3872c89434 for instance c20304f5-8614-4b22-a414-e1c5d5a610e1 on hv-cinder-84131 Jul 27 15:36:08.145011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-fdff018a-0e17-4cc5-b591-31dd7432dd25 req-462f5db1-68bc-4c1e-a489-37a09782a753 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056457 Jul 27 15:36:08.145748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 435/864] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:08.167533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:08.168093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:08.175172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.175615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.176561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.176993 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.199912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] HTTP exception thrown: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Request method failure captured: Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a HTTP/1.1 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmxJuol-OSo87paFWKy5Mj7hRP8EMPA5c7wVrZl9q3seXpIDejapcF2_5M6VtsporaMnNPdUxeSTsbsmi6ypf4Aq-wN8Km_WHLw71HRUxE6rF6qKgvJg3UJZnfQ8d6v7vTgZTWIjHeFat6cGGuv2HNf_YYO7COMMKUCmhMmUg6v6kk Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:36:08.201702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddfdba8b75e643b485b2237ae070a1b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 7a964a003f8e4f1da603a13eb7f534ca Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.203365 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '27c0a14c-8873-4689-9e66-43ba0b7c934a'} Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:08.204107 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.205867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.208172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Returning 404 to user: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:08.208172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f29c7bed-e358-4339-bdce-da6cfc8ccc3a tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 404 len: 111 microversion: 2.20 time: 0.040391 Jul 27 15:36:08.208172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 430/865] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Jul 27 15:36:08 2022] DELETE /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:36:08.212733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:08.213425 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 27c0a14c-8873-4689-9e66-43ba0b7c934a] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:08.220426 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.221636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.222230 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.222669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.236823 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] HTTP exception thrown: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Request method failure captured: Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a HTTP/1.1 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmxJuol-OSo87paFWKy5Mj7hRP8EMPA5c7wVrZl9q3seXpIDejapcF2_5M6VtsporaMnNPdUxeSTsbsmi6ypf4Aq-wN8Km_WHLw71HRUxE6rF6qKgvJg3UJZnfQ8d6v7vTgZTWIjHeFat6cGGuv2HNf_YYO7COMMKUCmhMmUg6v6kk Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:36:08.240912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddfdba8b75e643b485b2237ae070a1b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 7a964a003f8e4f1da603a13eb7f534ca Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.244092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '27c0a14c-8873-4689-9e66-43ba0b7c934a'} Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:08.245747 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. Jul 27 15:36:08.248883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:08.251345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Returning 404 to user: Instance 27c0a14c-8873-4689-9e66-43ba0b7c934a could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:08.251345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7efbad0d-e63a-48ca-8e4a-1fbd25a97e18 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a" status: 404 len: 111 microversion: 2.20 time: 0.034095 Jul 27 15:36:08.251345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 436/866] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:08 2022] GET /compute/v2.1/servers/27c0a14c-8873-4689-9e66-43ba0b7c934a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:36:08.835333 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:08.835983 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:08.842357 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.842805 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.843588 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:08.844050 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:08.861386 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:08.997549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:09.006216 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0ac33d52-6d12-4c26-9027-a567d19713b3 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.175323 Jul 27 15:36:09.006918 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 431/867] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:08 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:09.432306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:09.432916 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:09.440535 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:09.440986 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:09.441773 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:09.442217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:09.458484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] HTTP exception thrown: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Request method failure captured: Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc HTTP/1.1 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VmxJuol-OSo87paFWKy5Mj7hRP8EMPA5c7wVrZl9q3seXpIDejapcF2_5M6VtsporaMnNPdUxeSTsbsmi6ypf4Aq-wN8Km_WHLw71HRUxE6rF6qKgvJg3UJZnfQ8d6v7vTgZTWIjHeFat6cGGuv2HNf_YYO7COMMKUCmhMmUg6v6kk Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:36:09.460151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddfdba8b75e643b485b2237ae070a1b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 7a964a003f8e4f1da603a13eb7f534ca Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.462617 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '0c7540c3-cdec-4257-bea3-93599c6919cc'} Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:09.463877 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.466051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.468311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Returning 404 to user: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:09.468311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-96ccce3c-bcdb-4f30-9e36-253523766abd tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 404 len: 111 microversion: 2.20 time: 0.033607 Jul 27 15:36:09.468311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 437/868] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Jul 27 15:36:09 2022] DELETE /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:36:09.474357 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:09.475335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] [instance: 0c7540c3-cdec-4257-bea3-93599c6919cc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:09.478815 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:09.485920 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:09.486366 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:09.487147 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:09.487595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:09.504731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] HTTP exception thrown: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Request method failure captured: Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc HTTP/1.1 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VmxJuol-OSo87paFWKy5Mj7hRP8EMPA5c7wVrZl9q3seXpIDejapcF2_5M6VtsporaMnNPdUxeSTsbsmi6ypf4Aq-wN8Km_WHLw71HRUxE6rF6qKgvJg3UJZnfQ8d6v7vTgZTWIjHeFat6cGGuv2HNf_YYO7COMMKUCmhMmUg6v6kk Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:36:09.506403 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddfdba8b75e643b485b2237ae070a1b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddfdba8b75e643b485b2237ae070a1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: ddfdba8b75e643b485b2237ae070a1b2 Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1046408845 Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 7a964a003f8e4f1da603a13eb7f534ca Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1046408845-project Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.507934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '0c7540c3-cdec-4257-bea3-93599c6919cc'} Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:09.508669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. Jul 27 15:36:09.510125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:09.511384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] Returning 404 to user: Instance 0c7540c3-cdec-4257-bea3-93599c6919cc could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:09.511384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2d1ff72b-e9ac-4d08-89cb-8dfa11a46938 tempest-AttachVolumeShelveTestJSON-1046408845 tempest-AttachVolumeShelveTestJSON-1046408845-project] 10.222.0.36 "GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc" status: 404 len: 111 microversion: 2.20 time: 0.039919 Jul 27 15:36:09.511384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 432/869] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jul 27 15:36:09 2022] GET /compute/v2.1/servers/0c7540c3-cdec-4257-bea3-93599c6919cc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:36:10.027405 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:10.028377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:10.036091 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:10.036534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:10.037322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:10.037755 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:10.210555 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:10.218554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8db8278e-704c-44dd-b4b4-70df133658b6 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1267 microversion: 2.1 time: 0.195071 Jul 27 15:36:10.219333 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 438/870] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:10 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:11.257780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:11.259416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:11.275112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:11.275688 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:11.276661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:11.277323 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:11.521703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:11.535220 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1edb0390-89c6-4f12-9b5c-3b472b86ca55 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1454 microversion: 2.1 time: 0.297395 Jul 27 15:36:11.536113 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 433/871] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:11 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1454 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:11.557844 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:11.558575 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:11.566131 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:11.566589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:11.567373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:11.567812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:11.757563 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:11.772830 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c6b2d0cf-95ef-4485-979b-22d41b63986a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1454 microversion: 2.1 time: 0.218385 Jul 27 15:36:11.773801 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 439/872] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:11 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:36:14.950681 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-72fba4c7-7394-4463-beea-cfa8624223e2 req-9eac1234-3c3e-4bef-81eb-45d93e1cedf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20304f5-8614-4b22-a414-e1c5d5a610e1", "tag": "a74c612d-f030-4677-ac76-2b3872c89434"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:14.965412 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-72fba4c7-7394-4463-beea-cfa8624223e2 req-9eac1234-3c3e-4bef-81eb-45d93e1cedf9 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:14.966175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-72fba4c7-7394-4463-beea-cfa8624223e2 req-9eac1234-3c3e-4bef-81eb-45d93e1cedf9 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:15.168828 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-72fba4c7-7394-4463-beea-cfa8624223e2 req-9eac1234-3c3e-4bef-81eb-45d93e1cedf9 service nova] Creating event network-changed:a74c612d-f030-4677-ac76-2b3872c89434 for instance c20304f5-8614-4b22-a414-e1c5d5a610e1 on hv-cinder-84131 Jul 27 15:36:15.174587 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-72fba4c7-7394-4463-beea-cfa8624223e2 req-9eac1234-3c3e-4bef-81eb-45d93e1cedf9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227057 Jul 27 15:36:15.175780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 434/873] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:34.745050 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:34.745537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:34.747712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=9 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:34.748455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=55 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:34.755670 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:34.756159 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:34.756929 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:34.757363 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:34.785278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-3f1e4486-7440-4520-9321-81c98991ee57 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/ips" status: 200 len: 149 microversion: 2.1 time: 0.044090 Jul 27 15:36:34.786260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 440/874] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:36:34 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:34.796422 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=5 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:34.797981 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=13 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:34.804605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b4b1af-1a3a-47cc-b8f9-e31d02184810"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:34.808474 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:34.817326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:34.817967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:34.821261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:34.822306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:34.987376 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Invalid volume: volume 93b4b1af-1a3a-47cc-b8f9-e31d02184810 is already attached to instances: 601af892-ad4b-4797-8590-70c82bc772c3 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: POST /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/os-volume_attachments HTTP/1.1 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 74 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:36:34.989181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {"volumeAttachment": {"volumeId": "93b4b1af-1a3a-47cc-b8f9-e31d02184810"}} Jul 27 15:36:34.991698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Invalid volume: volume 93b4b1af-1a3a-47cc-b8f9-e31d02184810 is already attached to instances: 601af892-ad4b-4797-8590-70c82bc772c3 Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'server_id': 'dc517287-de76-4a17-94aa-a47eb0588266', 'body': {'volumeAttachment': {'volumeId': '93b4b1af-1a3a-47cc-b8f9-e31d02184810'}}} Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 93b4b1af-1a3a-47cc-b8f9-e31d02184810 is already attached to instances: 601af892-ad4b-4797-8590-70c82bc772c3 Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:34.993634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 93b4b1af-1a3a-47cc-b8f9-e31d02184810 is already attached to instances: 601af892-ad4b-4797-8590-70c82bc772c3 Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:34.995762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 93b4b1af-1a3a-47cc-b8f9-e31d02184810 is already attached to instances: 601af892-ad4b-4797-8590-70c82bc772c3 Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 400 to user: Invalid volume: volume 93b4b1af-1a3a-47cc-b8f9-e31d02184810 is already attached to instances: 601af892-ad4b-4797-8590-70c82bc772c3 {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-805bd2d6-6e36-4213-a078-796e2ff48de7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196617 Jul 27 15:36:34.998535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 435/875] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:36:34 2022] POST /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:36:35.001331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:35.001784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:35.008060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:35.008510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:35.009289 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:35.009712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:35.036558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:36:35.140587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-58fc59cb-ef10-4656-9a14-1b18537d13b2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 204 len: 0 microversion: 2.1 time: 0.143414 Jul 27 15:36:35.141365 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 441/876] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:36:34 2022] DELETE /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:36:35.150733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:35.151427 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:35.159371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:35.159993 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:35.161015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:35.161632 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:35.315533 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:35.323236 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-df1b03af-7157-4513-bc60-f9fbaa54c83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1680 microversion: 2.1 time: 0.176652 Jul 27 15:36:35.323796 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 436/877] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:35 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:36.349489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:36.350201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:36.356962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:36.357488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:36.358184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:36.358720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:36.521855 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:36.531922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-01242fcd-ded2-404a-806d-7ffb5a7459ed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1680 microversion: 2.1 time: 0.186739 Jul 27 15:36:36.532848 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 442/878] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:36 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:37.554628 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:37.555957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:37.563657 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:37.564638 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:37.565655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:37.566432 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:37.671342 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:37.679137 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-37892794-16f2-43ea-8861-389ed3f5c745 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 200 len: 1612 microversion: 2.1 time: 0.128656 Jul 27 15:36:37.680321 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 437/879] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:37 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 1612 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:37.800629 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-15d73276-6e05-4d08-bf00-387ea0423f4d req-1d04a4a1-df33-42a5-a45f-c4fd75702556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc517287-de76-4a17-94aa-a47eb0588266", "name": "network-vif-deleted", "tag": "a1da6a28-167f-49d0-b01c-8513acaf72d7"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:37.841090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-15d73276-6e05-4d08-bf00-387ea0423f4d req-1d04a4a1-df33-42a5-a45f-c4fd75702556 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:37.849183 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-15d73276-6e05-4d08-bf00-387ea0423f4d req-1d04a4a1-df33-42a5-a45f-c4fd75702556 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:37.884455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-15d73276-6e05-4d08-bf00-387ea0423f4d req-1d04a4a1-df33-42a5-a45f-c4fd75702556 service nova] Creating event network-vif-deleted:a1da6a28-167f-49d0-b01c-8513acaf72d7 for instance dc517287-de76-4a17-94aa-a47eb0588266 on hv-cinder-84131 Jul 27 15:36:37.903240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-15d73276-6e05-4d08-bf00-387ea0423f4d req-1d04a4a1-df33-42a5-a45f-c4fd75702556 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109168 Jul 27 15:36:37.907942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 443/880] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:38.701750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:38.703600 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:38.717431 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:38.717914 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:38.718690 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:38.719222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:38.735563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 HTTP/1.1 Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:36:38.739093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:36:38.744275 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'dc517287-de76-4a17-94aa-a47eb0588266'} Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:38.745292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:36:38.746888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:38.748247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:38.748247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6e195dea-a3dc-4755-940a-a62d2b89a2f2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 404 len: 111 microversion: 2.1 time: 0.040840 Jul 27 15:36:38.748247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 438/881] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:38 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:36:38.750455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1ca85a12-89d6-4ada-b91a-cdff91f03bfa tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '.version_select at 0x7f9fe022fb80>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:38.774738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1ca85a12-89d6-4ada-b91a-cdff91f03bfa tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248576442" status: 202 len: 0 microversion: 2.1 time: 0.030214 Jul 27 15:36:38.775420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 444/882] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Jul 27 15:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248576442 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:36:39.617856 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:39.618418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:39.624747 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:39.625417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:39.626735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:39.627166 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:39.720545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lazy-loading 'services' on Instance uuid 601af892-ad4b-4797-8590-70c82bc772c3 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:36:39.804503 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3124eac2-94f5-4aeb-86b5-575461a71472 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments/93b4b1af-1a3a-47cc-b8f9-e31d02184810" status: 202 len: 0 microversion: 2.1 time: 0.189996 Jul 27 15:36:39.805171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 439/883] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:36:39 2022] DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments/93b4b1af-1a3a-47cc-b8f9-e31d02184810 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:36:39.814952 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:39.817260 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:39.826242 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:39.826954 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:39.827741 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:39.828220 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:39.860457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2a79ae68-f662-4861-8ffd-ed782e18ba3c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049784 Jul 27 15:36:39.861188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 445/884] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:36:39 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:40.874284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:40.876663 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:40.883965 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:40.884585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:40.885335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:40.885835 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:40.919760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-83f73b6f-51e5-46f4-9a89-bbd4e49554a9 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049810 Jul 27 15:36:40.920585 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 440/885] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:36:40 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:36:40.993526 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:40.994112 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:41.003305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:41.003305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:41.003796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:41.004483 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:41.032809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:36:41.112774 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1672cd16-8983-4295-bed9-e5509a1ca2d7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 204 len: 0 microversion: 2.1 time: 0.125359 Jul 27 15:36:41.113581 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 446/886] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:36:40 2022] DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:36:41.122949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:41.123561 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:41.130030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:41.130471 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:41.131230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:41.131655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:41.273669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:41.281620 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-44e2e2e1-176b-4929-acdf-651751a7cb3a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1683 microversion: 2.1 time: 0.163599 Jul 27 15:36:41.282448 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 441/887] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:41 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:36:42.304034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:42.304738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:42.311436 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:42.311910 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:42.312681 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:42.313762 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:42.461023 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:42.468438 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9fdd6c27-6c96-4fe2-adef-dc9e63d0c60f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1683 microversion: 2.1 time: 0.168902 Jul 27 15:36:42.469677 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 447/888] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:42 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:43.490306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:43.490932 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:43.497522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:43.497968 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:43.498738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:43.499174 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:43.645022 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:43.652903 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7ec678b4-660a-4503-884d-58f58eefc986 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1683 microversion: 2.1 time: 0.166519 Jul 27 15:36:43.653568 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 442/889] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:43 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:44.676631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:44.677291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:44.684643 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:44.685603 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:44.686400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:44.686847 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:45.298182 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:45.309478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ee6da12b-b21c-43f2-abf7-2e7cbc27fa67 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1683 microversion: 2.1 time: 0.636714 Jul 27 15:36:45.320640 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 448/890] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:44 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1683 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:45.585283 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b9c21251-138b-4014-a3d5-28af5d3464bf req-52b33a2b-8634-45f7-b6ba-51924c16cb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601af892-ad4b-4797-8590-70c82bc772c3", "name": "network-vif-deleted", "tag": "310d1b53-872f-4fbc-8c36-00e4731ac228"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:45.618814 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b9c21251-138b-4014-a3d5-28af5d3464bf req-52b33a2b-8634-45f7-b6ba-51924c16cb8f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:45.620235 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b9c21251-138b-4014-a3d5-28af5d3464bf req-52b33a2b-8634-45f7-b6ba-51924c16cb8f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:45.645713 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-b9c21251-138b-4014-a3d5-28af5d3464bf req-52b33a2b-8634-45f7-b6ba-51924c16cb8f service nova] Creating event network-vif-deleted:310d1b53-872f-4fbc-8c36-00e4731ac228 for instance 601af892-ad4b-4797-8590-70c82bc772c3 on hv-cinder-84131 Jul 27 15:36:45.670966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b9c21251-138b-4014-a3d5-28af5d3464bf req-52b33a2b-8634-45f7-b6ba-51924c16cb8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089578 Jul 27 15:36:45.672039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 443/891] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:46.335696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:46.336615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:46.345625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:46.346981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:46.348686 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:46.350221 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:46.400469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:46.400980 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:46.401454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lazy-loading 'fault' on Instance uuid 601af892-ad4b-4797-8590-70c82bc772c3 {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:36:46.467683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:46.482280 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9910c9b4-8d0b-4d54-8084-392f9e6c402f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 200 len: 1331 microversion: 2.1 time: 0.150885 Jul 27 15:36:46.496691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 449/892] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:46 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 1331 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:47.509719 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:47.510568 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:47.517821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:47.518267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:47.519047 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:47.519478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:47.534525 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 HTTP/1.1 Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:36:47.536243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:36:47.537821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '601af892-ad4b-4797-8590-70c82bc772c3'} Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:36:47.538595 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:36:47.539948 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:36:47.541142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:36:47.541142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ec73c14a-2c7d-4a03-8417-c445ff2a2dbd tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 404 len: 111 microversion: 2.1 time: 0.036023 Jul 27 15:36:47.541142 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 444/893] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:47 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:36:47.547995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-888c2f8b-cd77-433a-a5c2-5df1ef41435b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '.version_select at 0x7f9fe02cc790>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:47.572705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-888c2f8b-cd77-433a-a5c2-5df1ef41435b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138480301" status: 202 len: 0 microversion: 2.1 time: 0.029319 Jul 27 15:36:47.573469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 450/894] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Jul 27 15:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138480301 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:36:48.397002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5b8b8cf9-4178-4c5e-bfb6-7661f5c7a71d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: .version_select at 0x7f9fd3b59430>, body: {"keypair": {"name": "tempest-keypair-1580740784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMGazgIg90x7zi5XxCZahz6o4mmVusleK7764kDXd1YEOD/Zxao8G8ww/oT0kZnJyi5T7NpGsggOZPspddCRnL503aLmxOHXuIK8GI8CmYPbohhHV9KFwQHBKpToIYMcw=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:48.427898 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-5b8b8cf9-4178-4c5e-bfb6-7661f5c7a71d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:36:48.432485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-5b8b8cf9-4178-4c5e-bfb6-7661f5c7a71d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:36:48.463317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5b8b8cf9-4178-4c5e-bfb6-7661f5c7a71d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071363 Jul 27 15:36:48.464110 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 445/895] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:36:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:50.240931 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-739460143", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb"}], "security_groups": [{"name": "tempest-securitygroup--970255466"}], "key_name": "tempest-keypair-1580740784", "user_data": "}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:50.434799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] validate_networks() for [('a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:36:50.956128 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:36:50.956556 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:36:50.957346 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:36:50.957766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:36:50.958329 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:36:50.967618 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:50.969551 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:50.970378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:50.970816 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:50.994088 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:36:51.004842 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:36:51.018846 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:36:51.021216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:36:51.072950 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4ecef0d1-2d5a-4086-94cb-a890839b018f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.837698 Jul 27 15:36:51.075656 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 451/896] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:36:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:36:51.087890 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3dfed2a7-b9c5-4cd2-b9d9-3c67dd27b2e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:51.090143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3dfed2a7-b9c5-4cd2-b9d9-3c67dd27b2e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:51.184793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3dfed2a7-b9c5-4cd2-b9d9-3c67dd27b2e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:51.204453 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3dfed2a7-b9c5-4cd2-b9d9-3c67dd27b2e0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1241 microversion: 2.1 time: 0.121277 Jul 27 15:36:51.205704 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 446/897] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:51 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:36:52.233518 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:52.235340 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:52.245021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:52.248049 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:52.249008 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:52.249946 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:52.358778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:52.369242 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dd3b79ef-0633-4d3d-939d-84fbe0a40ba3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1293 microversion: 2.1 time: 0.143286 Jul 27 15:36:52.377220 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 452/898] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:52 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:53.401608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:53.402746 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:53.410060 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:53.410515 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:53.411792 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:53.412277 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:53.539983 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:53.551707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f06bb6e6-8edd-401f-a54f-d4733e851aef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1299 microversion: 2.1 time: 0.154040 Jul 27 15:36:53.552878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 447/899] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:53 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:54.577817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:54.579639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:54.589853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:54.590697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:54.591581 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:54.592174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:54.784179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:54.795259 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c2b91124-9e7d-4d8a-b62a-953e8f0cade4 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.221255 Jul 27 15:36:54.809400 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 453/900] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:54 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:55.332200 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-43c11f92-f708-4e1d-806e-91daabf179ed req-8282c08e-b556-4f5e-8a11-ff8ad9decf70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a2fff2-0034-437f-be7e-bcba679c0b2f", "tag": "82a9f1b2-b04d-4236-b0ad-f4bacb75fe42"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:36:55.343171 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-43c11f92-f708-4e1d-806e-91daabf179ed req-8282c08e-b556-4f5e-8a11-ff8ad9decf70 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:55.350143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-43c11f92-f708-4e1d-806e-91daabf179ed req-8282c08e-b556-4f5e-8a11-ff8ad9decf70 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:55.377964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-43c11f92-f708-4e1d-806e-91daabf179ed req-8282c08e-b556-4f5e-8a11-ff8ad9decf70 service nova] Creating event network-changed:82a9f1b2-b04d-4236-b0ad-f4bacb75fe42 for instance 74a2fff2-0034-437f-be7e-bcba679c0b2f on hv-cinder-84131 Jul 27 15:36:55.388120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-43c11f92-f708-4e1d-806e-91daabf179ed req-8282c08e-b556-4f5e-8a11-ff8ad9decf70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057906 Jul 27 15:36:55.392436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 448/901] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:36:55.819217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:55.819981 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:55.828200 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:55.832455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:55.833608 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:55.838921 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:56.026966 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:56.036835 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-90312c2b-be75-4b98-9b6b-50c4571e027e tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.221051 Jul 27 15:36:56.037472 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 454/902] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:55 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:57.059967 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:57.061369 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:57.077818 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:57.078534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:57.080733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:57.081629 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:57.316729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:57.332392 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5b716569-0992-480e-ae8a-de402c9d7ef3 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.276723 Jul 27 15:36:57.333160 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 449/903] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:57 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:36:58.362435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:58.363151 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:58.370999 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:58.376567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:58.378737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:58.379850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:58.783427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:36:58.803206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-94b5b5c8-16df-4b6f-b9b6-e4a855246fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.447855 Jul 27 15:36:58.804303 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 455/904] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:58 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:36:59.847685 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:36:59.848481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:36:59.860251 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:59.861209 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:36:59.862690 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:36:59.863860 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:00.063713 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:00.073571 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6eb9505b-e56d-46a6-9702-3d6b64f4bff1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.245355 Jul 27 15:37:00.080772 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 450/905] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:36:59 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:01.097169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:01.098411 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:01.101534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:01.103262 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:01.110112 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:01.110812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:01.111759 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:01.112377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:01.137859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:01.319346 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:01.330095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f50b28ba-0bef-421e-8e7a-e1ef9393bfce tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.238555 Jul 27 15:37:01.340560 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 456/906] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:01 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:37:02.357123 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:02.360902 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:02.372035 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:02.376077 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:02.376917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:02.377976 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:02.378651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:02.680894 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:02.692541 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d0594d93-8837-4704-8207-167d4c476566 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.341273 Jul 27 15:37:02.693244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 451/907] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:02 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:03.134271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-effa435b-90fe-49ac-9b14-eda9fab54f62 req-cc90a933-7382-4b9d-a49f-9153510594e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a2fff2-0034-437f-be7e-bcba679c0b2f", "name": "network-vif-plugged", "status": "completed", "tag": "82a9f1b2-b04d-4236-b0ad-f4bacb75fe42"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:03.155987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-effa435b-90fe-49ac-9b14-eda9fab54f62 req-cc90a933-7382-4b9d-a49f-9153510594e2 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:03.157323 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-effa435b-90fe-49ac-9b14-eda9fab54f62 req-cc90a933-7382-4b9d-a49f-9153510594e2 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:03.203442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-effa435b-90fe-49ac-9b14-eda9fab54f62 req-cc90a933-7382-4b9d-a49f-9153510594e2 service nova] Creating event network-vif-plugged:82a9f1b2-b04d-4236-b0ad-f4bacb75fe42 for instance 74a2fff2-0034-437f-be7e-bcba679c0b2f on hv-cinder-84131 Jul 27 15:37:03.215353 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-effa435b-90fe-49ac-9b14-eda9fab54f62 req-cc90a933-7382-4b9d-a49f-9153510594e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083016 Jul 27 15:37:03.218504 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 452/908] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:37:03.378190 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5c10cda7-0323-4424-9ae3-2f8b6c8c5550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Action: 'create', calling method: .version_select at 0x7f9fe026a670>, body: {"keypair": {"name": "tempest-TestShelveInstance-408114322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKYdaxgdzvaffwQFdzC1ELspdAwpgscs/47uIe57evGWXf4Ur2w2z03CYWgx85aSSlLGDKkl7E+liHctofzjbvtpOvORLhFtKIso/SiccDKd+P1iLMxicXqhiRuYx+Iyw=="}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:03.409153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-5c10cda7-0323-4424-9ae3-2f8b6c8c5550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Getting quotas for project 1f420f7f5f5947088f23da2dab9f0fd7. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:37:03.418288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-5c10cda7-0323-4424-9ae3-2f8b6c8c5550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Getting quotas for user 37a42563c3d34a689c3cec947d649fc1 and project 1f420f7f5f5947088f23da2dab9f0fd7. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:37:03.460240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5c10cda7-0323-4424-9ae3-2f8b6c8c5550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.518032 Jul 27 15:37:03.461194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 457/909] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:37:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:03.723888 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:03.725626 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:03.736776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:03.737823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:03.739131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:03.739810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:03.957887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:03.972582 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-61ba8224-9035-4392-8447-e58973cd843a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.258110 Jul 27 15:37:03.986339 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 453/910] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:03 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:04.998296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:04.998984 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:05.009172 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:05.011348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:05.012527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:05.014171 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:05.014723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:05.235512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:05.244911 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-777b6ada-2506-4d80-9a5b-58b6d248bee7 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1366 microversion: 2.1 time: 0.253327 Jul 27 15:37:05.245653 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 458/911] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:04 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:06.269906 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:06.270600 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:06.272975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:06.278867 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:06.279325 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:06.280328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:06.280768 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:06.284353 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:06.428829 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:06.438646 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c1292c82-b793-401f-9cf5-c4cf739d1357 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1556 microversion: 2.1 time: 0.172652 Jul 27 15:37:06.439214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 454/912] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:06 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:06.459195 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:06.459782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:06.466402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:06.466861 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:06.468308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:06.468805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:06.558110 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0deb7050-262c-4b69-97ff-f3361a67b3ea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102836 Jul 27 15:37:06.559625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 459/913] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:37:06 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:07.741655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-a8d9c2e3-6004-4416-9bdc-dc74f01d5c42 req-29a89136-475f-4e08-a512-a5308518c440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a2fff2-0034-437f-be7e-bcba679c0b2f", "tag": "82a9f1b2-b04d-4236-b0ad-f4bacb75fe42"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:07.752046 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-a8d9c2e3-6004-4416-9bdc-dc74f01d5c42 req-29a89136-475f-4e08-a512-a5308518c440 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:07.752493 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-a8d9c2e3-6004-4416-9bdc-dc74f01d5c42 req-29a89136-475f-4e08-a512-a5308518c440 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:07.766379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-a8d9c2e3-6004-4416-9bdc-dc74f01d5c42 req-29a89136-475f-4e08-a512-a5308518c440 service nova] Creating event network-changed:82a9f1b2-b04d-4236-b0ad-f4bacb75fe42 for instance 74a2fff2-0034-437f-be7e-bcba679c0b2f on hv-cinder-84131 Jul 27 15:37:07.771886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-a8d9c2e3-6004-4416-9bdc-dc74f01d5c42 req-29a89136-475f-4e08-a512-a5308518c440 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033716 Jul 27 15:37:07.772806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 455/914] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:22.401374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=4 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:22.402184 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:22.402801 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=12 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:22.406753 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2029301366", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-408114322", "security_groups": [{"name": "tempest-secgroup-smoke-1426873221"}], "networks": [{"uuid": "1fd80b0f-495d-4f71-90b9-50d0753d3896"}], "block_device_mapping_v2": [{"uuid": "a7bc8499-a4c2-456a-a0d8-4ff8b573d09a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:22.521743 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] validate_networks() for [('1fd80b0f-495d-4f71-90b9-50d0753d3896', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:37:22.896163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:37:22.896586 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:37:22.897056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:37:22.897456 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:37:22.897890 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:37:22.907135 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:22.907579 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:22.908420 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:22.908859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:22.928336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Getting quotas for project 1f420f7f5f5947088f23da2dab9f0fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:37:22.932712 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Getting quotas for user 37a42563c3d34a689c3cec947d649fc1 and project 1f420f7f5f5947088f23da2dab9f0fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:37:22.995850 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:37:22.997926 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7bc8499-a4c2-456a-a0d8-4ff8b573d09a',volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:37:23.130913 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-eb749446-c3c3-4dfe-a0e5-b3413485b638 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730838 Jul 27 15:37:23.131570 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 460/915] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:37:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:37:23.140550 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:23.141303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=7 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:23.147212 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-87995948-74ad-4e12-9dd9-2efc5a463906 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:23.148323 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-87995948-74ad-4e12-9dd9-2efc5a463906 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:23.204393 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-87995948-74ad-4e12-9dd9-2efc5a463906 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:23.213985 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-87995948-74ad-4e12-9dd9-2efc5a463906 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1088 microversion: 2.1 time: 0.075009 Jul 27 15:37:23.214577 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 456/916] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:23 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:24.236331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:24.236871 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:24.243639 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:24.244116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:24.244878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:24.245305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:24.307507 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:24.316075 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2f5caf19-515d-4e7c-a0e1-e44717cbd0a9 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1138 microversion: 2.1 time: 0.084651 Jul 27 15:37:24.316919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 461/917] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:24 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:25.336907 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:25.337518 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:25.346314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:25.346765 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:25.347540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:25.348008 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:25.413923 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:25.423750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f0000ff6-0881-4f6b-b319-e86322e35dc2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1130 microversion: 2.1 time: 0.090436 Jul 27 15:37:25.424436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 457/918] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:25 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1130 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:26.446545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:26.447153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:26.461969 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:26.462720 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:26.463677 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:26.464140 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:26.561146 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:26.574300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0c93b297-3312-4b37-96bf-d4c61359b59a tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1204 microversion: 2.1 time: 0.131256 Jul 27 15:37:26.575265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 462/919] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:26 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1204 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:27.405031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-678a4001-31c0-40e9-b47c-69a27c46f56b req-3047b01f-9462-42c8-a303-b9e6e194d675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:27.417405 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-678a4001-31c0-40e9-b47c-69a27c46f56b req-3047b01f-9462-42c8-a303-b9e6e194d675 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:27.418065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-678a4001-31c0-40e9-b47c-69a27c46f56b req-3047b01f-9462-42c8-a303-b9e6e194d675 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:27.433318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-678a4001-31c0-40e9-b47c-69a27c46f56b req-3047b01f-9462-42c8-a303-b9e6e194d675 service nova] Creating event network-changed:89a43d90-e38e-4f3f-b165-519e1d370bb5 for instance c7840eb4-8d99-45cb-9386-62ee3acea42b on hv-cinder-84131 Jul 27 15:37:27.439111 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-678a4001-31c0-40e9-b47c-69a27c46f56b req-3047b01f-9462-42c8-a303-b9e6e194d675 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038263 Jul 27 15:37:27.440017 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 458/920] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:37:27.598437 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:27.599523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:27.606134 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:27.606584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:27.607355 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:27.607788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:27.742829 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:27.751121 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7395fd69-50c1-420a-a4c7-650d0e047c30 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.158206 Jul 27 15:37:27.751757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 463/921] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:27 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:28.773067 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:28.773921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:28.780778 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:28.781232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:28.782009 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:28.782443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:28.991937 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:29.000357 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9e69d5a1-a3ed-4996-93f6-7a04b6a0a79c tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.231794 Jul 27 15:37:29.001177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 459/922] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:28 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:30.022025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:30.022597 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:30.029207 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:30.029650 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:30.031044 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:30.031608 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:30.181322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:30.189916 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-925ac343-7e88-425a-88dd-2bbd374079bb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.171777 Jul 27 15:37:30.190488 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 464/923] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:30 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:31.210350 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:31.211194 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:31.219143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:31.219592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:31.220384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:31.220825 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:31.373272 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:31.380979 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d2394c39-07c6-4c52-ac0f-7981e4d42a93 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.174386 Jul 27 15:37:31.381540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 460/924] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:31 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:32.403732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:32.404384 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:32.411886 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:32.412339 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:32.413109 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:32.413537 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:32.571565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:32.579715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d8670c3c-e98b-4e61-8c48-abf9b7ac0396 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.179782 Jul 27 15:37:32.580320 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 465/925] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:32 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:33.602517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:33.603214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:33.605886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:33.611590 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:33.612072 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:33.612836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:33.613266 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:33.756400 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:33.767729 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-276fcb17-b15c-4adf-86c3-f074e90f64b6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.169521 Jul 27 15:37:33.768598 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 461/926] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:33 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:34.789179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:34.789776 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:34.791646 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:34.792339 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:34.799390 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:34.799853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:34.800632 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:34.801066 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:34.942093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:34.949750 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-68f8d473-23df-40eb-b3d1-1c4b249c5d4f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.164494 Jul 27 15:37:34.950539 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 466/927] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:34 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:35.971210 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:35.971855 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:35.978476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:35.978929 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:35.979720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:35.980182 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:36.120535 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:36.129112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dc07e1bc-9e5f-443b-a2c3-4b7048c22be3 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.162127 Jul 27 15:37:36.130126 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 462/928] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:35 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:37.150873 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:37.151465 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:37.157601 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:37.158051 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:37.158809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:37.159241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:37.303548 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:37.311799 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f7849a8c-af6a-4aed-a182-4aee5348507f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.164166 Jul 27 15:37:37.312381 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 467/929] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:37 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:38.334455 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:38.335075 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:38.341189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:38.341634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:38.343124 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:38.343555 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:38.486994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:38.494794 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-515738ae-2b41-4968-9371-01f9d6b121ac tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.164790 Jul 27 15:37:38.495363 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 463/930] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:38 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:38.648594 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-1f176b61-fa55-444a-ad0d-ff04740fbc95 req-af53c141-1d2e-405f-9645-67ec04ec8b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "name": "network-vif-plugged", "status": "completed", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:38.660265 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-1f176b61-fa55-444a-ad0d-ff04740fbc95 req-af53c141-1d2e-405f-9645-67ec04ec8b23 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:38.660716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-1f176b61-fa55-444a-ad0d-ff04740fbc95 req-af53c141-1d2e-405f-9645-67ec04ec8b23 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:38.675696 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-1f176b61-fa55-444a-ad0d-ff04740fbc95 req-af53c141-1d2e-405f-9645-67ec04ec8b23 service nova] Creating event network-vif-plugged:89a43d90-e38e-4f3f-b165-519e1d370bb5 for instance c7840eb4-8d99-45cb-9386-62ee3acea42b on hv-cinder-84131 Jul 27 15:37:38.681787 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-1f176b61-fa55-444a-ad0d-ff04740fbc95 req-af53c141-1d2e-405f-9645-67ec04ec8b23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036649 Jul 27 15:37:38.682549 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 468/931] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:39.517666 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:39.518291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:39.524490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:39.524934 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:39.525696 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:39.526131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:39.682231 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:39.690459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1e2a6a65-8e1e-4835-a864-bd6a7521b274 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.177018 Jul 27 15:37:39.691039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 464/932] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:39 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:37:40.712659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:40.714249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:40.720896 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:40.721214 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:40.721984 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:40.722451 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:40.868791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:40.877139 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ca551ae9-3bb6-4687-be49-de610947b064 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1260 microversion: 2.1 time: 0.169694 Jul 27 15:37:40.877697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 469/933] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:40 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:41.898471 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:41.899065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:41.906093 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:41.906541 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:41.907314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:41.907762 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:42.052980 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:42.060836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-adb20d8e-d4af-4f22-85f0-1fc5f030d404 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1443 microversion: 2.1 time: 0.166343 Jul 27 15:37:42.061418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 465/934] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:41 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:42.081794 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:42.082634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:42.088822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:42.089267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:42.090016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:42.090446 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:42.233179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:42.241472 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-73fe3a0d-aa73-4bc9-b973-1ca3851f5a46 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1443 microversion: 2.1 time: 0.163691 Jul 27 15:37:42.242043 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 470/935] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:42 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:43.993841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:43.994995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:44.002596 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:44.003033 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-189740d9-3c37-4f0e-a6b3-b3454c70f7de req-d3c08dd3-dbac-4c7c-b2df-0acf49809481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20304f5-8614-4b22-a414-e1c5d5a610e1", "tag": "a74c612d-f030-4677-ac76-2b3872c89434"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:44.003516 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:44.004064 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:44.004747 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:44.015895 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-189740d9-3c37-4f0e-a6b3-b3454c70f7de req-d3c08dd3-dbac-4c7c-b2df-0acf49809481 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:44.017473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-189740d9-3c37-4f0e-a6b3-b3454c70f7de req-d3c08dd3-dbac-4c7c-b2df-0acf49809481 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:44.032023 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-189740d9-3c37-4f0e-a6b3-b3454c70f7de req-d3c08dd3-dbac-4c7c-b2df-0acf49809481 service nova] Creating event network-changed:a74c612d-f030-4677-ac76-2b3872c89434 for instance c20304f5-8614-4b22-a414-e1c5d5a610e1 on hv-cinder-84131 Jul 27 15:37:44.035181 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:37:44.037327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-189740d9-3c37-4f0e-a6b3-b3454c70f7de req-d3c08dd3-dbac-4c7c-b2df-0acf49809481 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038297 Jul 27 15:37:44.038071 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 471/936] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:44.168337 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9a62a687-36f5-4915-8cf4-a96b5073dc3e tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 204 len: 0 microversion: 2.1 time: 0.178596 Jul 27 15:37:44.169112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 466/937] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:37:43 2022] DELETE /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:37:44.181425 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:44.190893 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:44.198156 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:44.198604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:44.199387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:44.199837 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:44.311519 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-8c63d4b2-4cce-4831-b111-761e506aadd1 req-98f62df2-c847-440f-a8b1-435d1a809cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:44.334994 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-8c63d4b2-4cce-4831-b111-761e506aadd1 req-98f62df2-c847-440f-a8b1-435d1a809cb0 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:44.336148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-8c63d4b2-4cce-4831-b111-761e506aadd1 req-98f62df2-c847-440f-a8b1-435d1a809cb0 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:44.353783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-8c63d4b2-4cce-4831-b111-761e506aadd1 req-98f62df2-c847-440f-a8b1-435d1a809cb0 service nova] Creating event network-changed:89a43d90-e38e-4f3f-b165-519e1d370bb5 for instance c7840eb4-8d99-45cb-9386-62ee3acea42b on hv-cinder-84131 Jul 27 15:37:44.362801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-8c63d4b2-4cce-4831-b111-761e506aadd1 req-98f62df2-c847-440f-a8b1-435d1a809cb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061121 Jul 27 15:37:44.364750 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 467/938] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:44.418340 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:44.425896 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-5bbbf733-a23d-4954-8e25-0af136f5f2c8 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1579 microversion: 2.1 time: 0.251740 Jul 27 15:37:44.426661 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 472/939] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:44 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1579 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:45.449693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:45.450310 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:45.456972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:45.457414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:45.458161 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:45.458597 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:45.595651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:45.603219 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-df8de84a-f599-44d9-a612-0de340f7e8c7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1579 microversion: 2.1 time: 0.158377 Jul 27 15:37:45.603782 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 468/940] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:45 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:46.626374 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:46.627029 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:46.634937 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:46.635386 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:46.636206 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:46.636636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:46.931670 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:46.940079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a099a3e4-2fb8-4056-9de0-3de090ce7479 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1579 microversion: 2.1 time: 0.318405 Jul 27 15:37:46.940669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 473/941] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:46 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1579 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:47.882387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-413e0059-eb1e-4ea2-8283-d3a2c296faf2 req-0299b812-2f1e-4d48-9ad5-99b3db4475ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20304f5-8614-4b22-a414-e1c5d5a610e1", "name": "network-vif-deleted", "tag": "a74c612d-f030-4677-ac76-2b3872c89434"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:47.896293 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-413e0059-eb1e-4ea2-8283-d3a2c296faf2 req-0299b812-2f1e-4d48-9ad5-99b3db4475ed service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:47.896928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-413e0059-eb1e-4ea2-8283-d3a2c296faf2 req-0299b812-2f1e-4d48-9ad5-99b3db4475ed service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:47.910599 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-413e0059-eb1e-4ea2-8283-d3a2c296faf2 req-0299b812-2f1e-4d48-9ad5-99b3db4475ed service nova] Creating event network-vif-deleted:a74c612d-f030-4677-ac76-2b3872c89434 for instance c20304f5-8614-4b22-a414-e1c5d5a610e1 on hv-cinder-84131 Jul 27 15:37:47.915336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-413e0059-eb1e-4ea2-8283-d3a2c296faf2 req-0299b812-2f1e-4d48-9ad5-99b3db4475ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036718 Jul 27 15:37:47.916627 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 469/942] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:47.961779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:47.962596 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:47.969016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:47.969569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:47.970345 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:47.970780 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:48.035567 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:48.043481 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c27f0cab-e4d3-49ae-8d91-3916a89dccc7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 200 len: 1226 microversion: 2.1 time: 0.085932 Jul 27 15:37:48.044109 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 474/943] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:47 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:49.066875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:49.067669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: c20304f5-8614-4b22-a414-e1c5d5a610e1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:49.073975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:49.074423 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:49.075190 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:49.075630 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:49.090326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] HTTP exception thrown: Instance c20304f5-8614-4b22-a414-e1c5d5a610e1 could not be found. Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Request method failure captured: Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 HTTP/1.1 Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VnuBsol1KCJ2uvJEfXRa3j9wcPyTwz_ielSr9hwagnkjeShCITw6dSXA39Jfqn7HK5sHdF6GFFE4m-Z2CIZz4x-q0m8zIgkOoaLw7xYftaGQlpb5yds0WlO1g32ta4GhsZP4V4CGSTWamPkmlYml6XHfDqPM_XDPpWZz7qVQwB811g Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:37:49.092034 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3fd186ce4ca4030b191309f43d43baa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: d737eac8ae0343df9ace919d75596800 Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance c20304f5-8614-4b22-a414-e1c5d5a610e1 could not be found. Jul 27 15:37:49.093869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'c20304f5-8614-4b22-a414-e1c5d5a610e1'} Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20304f5-8614-4b22-a414-e1c5d5a610e1 could not be found. Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:37:49.094839 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20304f5-8614-4b22-a414-e1c5d5a610e1 could not be found. Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20304f5-8614-4b22-a414-e1c5d5a610e1 could not be found. Jul 27 15:37:49.096413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:49.097837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Returning 404 to user: Instance c20304f5-8614-4b22-a414-e1c5d5a610e1 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:37:49.097837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-61d4c666-6daa-403e-ab24-be7300bd3a7a tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1" status: 404 len: 111 microversion: 2.1 time: 0.031970 Jul 27 15:37:49.097837 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 470/944] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:49 2022] GET /compute/v2.1/servers/c20304f5-8614-4b22-a414-e1c5d5a610e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:37:50.145879 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:50.146448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:50.152779 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:50.153227 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:50.153973 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:50.154404 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:50.177805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-49e7b318-c211-49a6-9274-f279bf13802b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035703 Jul 27 15:37:50.178294 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 475/945] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:37:50 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:51.525669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d101ea9-0a2a-4ec6-9208-3e44ee8f62af"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:51.528119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:51.535222 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:51.535668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:51.536461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:51.536896 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:51.786935 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b4c92b19-8a24-4890-8718-8b984fa22dbe tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265123 Jul 27 15:37:51.787542 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 471/946] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:37:51 2022] POST /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:52.246882 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-7e774958-26d8-467a-adca-6ca0adbcf536 req-e049aff3-6270-4212-9874-b59aecddaed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615fb0b3-46e9-4b6e-80d1-0dbcce67d082", "tag": "91e538f2-eb06-41ad-a122-92406428be4c"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:52.248874 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:52.249448 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:52.257993 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:52.258480 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:52.259867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:52.259867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:52.264640 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7e774958-26d8-467a-adca-6ca0adbcf536 req-e049aff3-6270-4212-9874-b59aecddaed1 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:52.265410 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7e774958-26d8-467a-adca-6ca0adbcf536 req-e049aff3-6270-4212-9874-b59aecddaed1 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:52.280551 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-7e774958-26d8-467a-adca-6ca0adbcf536 req-e049aff3-6270-4212-9874-b59aecddaed1 service nova] Creating event network-changed:91e538f2-eb06-41ad-a122-92406428be4c for instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 on hv-cinder-84131 Jul 27 15:37:52.286988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-7e774958-26d8-467a-adca-6ca0adbcf536 req-e049aff3-6270-4212-9874-b59aecddaed1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044644 Jul 27 15:37:52.288101 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 472/947] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:37:52.300300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Going to try to terminate instance {{(pid=117869) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:37:52.398562 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dfda4f5e-df4e-4977-a18a-db54c87f3518 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "DELETE /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 204 len: 0 microversion: 2.1 time: 0.160479 Jul 27 15:37:52.399965 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 476/948] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:37:52 2022] DELETE /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:37:52.420411 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:52.421548 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:52.436641 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:52.437384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:52.438244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:52.438742 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:52.624227 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:52.628517 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:52.635987 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-51ead82a-3d0a-4028-acb4-da784a0f7989 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1579 microversion: 2.1 time: 0.227980 Jul 27 15:37:52.636997 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 473/949] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:52 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1579 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:53.659702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:53.660447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:53.662607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:53.667822 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:53.668313 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:53.669094 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:53.669534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:53.675187 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:53.821138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:53.831751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-52779a14-64b0-4ce0-8316-d7841162e46c tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1579 microversion: 2.1 time: 0.176853 Jul 27 15:37:53.834105 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 477/950] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:53 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:54.803413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-545c68b5-3ca8-45bb-8118-ae969d7b764e req-f0d78f36-b9db-42f8-bbe4-df1f11de9da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615fb0b3-46e9-4b6e-80d1-0dbcce67d082", "name": "network-vif-deleted", "tag": "91e538f2-eb06-41ad-a122-92406428be4c"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:37:54.810919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:54.818007 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-545c68b5-3ca8-45bb-8118-ae969d7b764e req-f0d78f36-b9db-42f8-bbe4-df1f11de9da3 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:54.818449 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-545c68b5-3ca8-45bb-8118-ae969d7b764e req-f0d78f36-b9db-42f8-bbe4-df1f11de9da3 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:54.832943 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-545c68b5-3ca8-45bb-8118-ae969d7b764e req-f0d78f36-b9db-42f8-bbe4-df1f11de9da3 service nova] Creating event network-vif-deleted:91e538f2-eb06-41ad-a122-92406428be4c for instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 on hv-cinder-84131 Jul 27 15:37:54.849086 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-545c68b5-3ca8-45bb-8118-ae969d7b764e req-f0d78f36-b9db-42f8-bbe4-df1f11de9da3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049489 Jul 27 15:37:54.850850 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 474/951] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:37:54.854825 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:54.855395 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:54.874482 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:54.875449 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:54.876452 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:54.877729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:54.945217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd737eac8ae0343df9ace919d75596800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd186ce4ca4030b191309f43d43baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:37:54.954090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e109c82a-674b-41a0-93fc-9e73574950ae tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 200 len: 1226 microversion: 2.1 time: 0.103277 Jul 27 15:37:54.955856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 478/952] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:54 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:37:55.975379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:55.976101 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 615fb0b3-46e9-4b6e-80d1-0dbcce67d082] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:55.982259 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:55.982706 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:55.983465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:55.983926 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:55.998434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] HTTP exception thrown: Instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 could not be found. Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Request method failure captured: Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 HTTP/1.1 Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VnuBsol1KCJ2uvJEfXRa3j9wcPyTwz_ielSr9hwagnkjeShCITw6dSXA39Jfqn7HK5sHdF6GFFE4m-Z2CIZz4x-q0m8zIgkOoaLw7xYftaGQlpb5yds0WlO1g32ta4GhsZP4V4CGSTWamPkmlYml6XHfDqPM_XDPpWZz7qVQwB811g Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:37:56.000811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3fd186ce4ca4030b191309f43d43baa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: d737eac8ae0343df9ace919d75596800 Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 could not be found. Jul 27 15:37:56.002478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '615fb0b3-46e9-4b6e-80d1-0dbcce67d082'} Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 could not be found. Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:37:56.003332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 could not be found. Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 could not be found. Jul 27 15:37:56.004654 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.005887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Returning 404 to user: Instance 615fb0b3-46e9-4b6e-80d1-0dbcce67d082 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:37:56.005887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ebd461d4-866a-413f-b06b-24d0573ba2d7 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082" status: 404 len: 111 microversion: 2.1 time: 0.031557 Jul 27 15:37:56.005887 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 475/953] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:55 2022] GET /compute/v2.1/servers/615fb0b3-46e9-4b6e-80d1-0dbcce67d082 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:37:56.482559 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:56.483237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:56.490521 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:56.490962 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:56.491800 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:56.492317 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:56.506600 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] HTTP exception thrown: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Request method failure captured: Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae HTTP/1.1 Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VnuBsol1KCJ2uvJEfXRa3j9wcPyTwz_ielSr9hwagnkjeShCITw6dSXA39Jfqn7HK5sHdF6GFFE4m-Z2CIZz4x-q0m8zIgkOoaLw7xYftaGQlpb5yds0WlO1g32ta4GhsZP4V4CGSTWamPkmlYml6XHfDqPM_XDPpWZz7qVQwB811g Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:37:56.508306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3fd186ce4ca4030b191309f43d43baa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: d737eac8ae0343df9ace919d75596800 Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.510083 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '8114946e-ea8e-4a5a-a622-f2a52620bfae'} Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:37:56.511003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.512501 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.513947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Returning 404 to user: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:37:56.513947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4462cd77-75b4-4eae-9e83-4ee04b2b3e39 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 404 len: 111 microversion: 2.1 time: 0.031012 Jul 27 15:37:56.513947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 479/954] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:37:56 2022] DELETE /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:37:56.519460 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:56.520189 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] [instance: 8114946e-ea8e-4a5a-a622-f2a52620bfae] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:37:56.526793 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:56.527244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:56.528053 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:37:56.528494 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:37:56.542559 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] HTTP exception thrown: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Request method failure captured: Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae HTTP/1.1 Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VnuBsol1KCJ2uvJEfXRa3j9wcPyTwz_ielSr9hwagnkjeShCITw6dSXA39Jfqn7HK5sHdF6GFFE4m-Z2CIZz4x-q0m8zIgkOoaLw7xYftaGQlpb5yds0WlO1g32ta4GhsZP4V4CGSTWamPkmlYml6XHfDqPM_XDPpWZz7qVQwB811g Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:37:56.544177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3fd186ce4ca4030b191309f43d43baa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3fd186ce4ca4030b191309f43d43baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: d3fd186ce4ca4030b191309f43d43baa Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395468617 Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: d737eac8ae0343df9ace919d75596800 Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-TestVolumeBootPattern-1395468617-project Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.545975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '8114946e-ea8e-4a5a-a622-f2a52620bfae'} Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:37:56.547864 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. Jul 27 15:37:56.549303 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:37:56.550563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Returning 404 to user: Instance 8114946e-ea8e-4a5a-a622-f2a52620bfae could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:37:56.550563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d81f5298-ac2d-4107-82a7-544780f994c4 tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae" status: 404 len: 111 microversion: 2.1 time: 0.030812 Jul 27 15:37:56.550563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 476/955] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:37:56 2022] GET /compute/v2.1/servers/8114946e-ea8e-4a5a-a622-f2a52620bfae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:37:57.886341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-93bdc2d7-4114-42e0-8008-20b391c6e78d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] Calling method '.version_select at 0x7f9fe02511f0>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:37:57.910423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-93bdc2d7-4114-42e0-8008-20b391c6e78d tempest-TestVolumeBootPattern-1395468617 tempest-TestVolumeBootPattern-1395468617-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1638862773" status: 202 len: 0 microversion: 2.1 time: 0.027995 Jul 27 15:37:57.911003 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 480/956] 10.222.0.36 () {58 vars in 1263 bytes} [Wed Jul 27 15:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1638862773 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:38:00.489240 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d101ea9-0a2a-4ec6-9208-3e44ee8f62af"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:00.493315 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:00.502695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:00.503378 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:00.504302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:00.504771 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:00.618717 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Invalid volume: volume 4d101ea9-0a2a-4ec6-9208-3e44ee8f62af is already attached to instances: 74a2fff2-0034-437f-be7e-bcba679c0b2f Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: POST /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments HTTP/1.1 Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 74 Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:38:00.621735 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {"volumeAttachment": {"volumeId": "4d101ea9-0a2a-4ec6-9208-3e44ee8f62af"}} Jul 27 15:38:00.623384 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Invalid volume: volume 4d101ea9-0a2a-4ec6-9208-3e44ee8f62af is already attached to instances: 74a2fff2-0034-437f-be7e-bcba679c0b2f Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'server_id': '74a2fff2-0034-437f-be7e-bcba679c0b2f', 'body': {'volumeAttachment': {'volumeId': '4d101ea9-0a2a-4ec6-9208-3e44ee8f62af'}}} Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4d101ea9-0a2a-4ec6-9208-3e44ee8f62af is already attached to instances: 74a2fff2-0034-437f-be7e-bcba679c0b2f Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:38:00.624443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4d101ea9-0a2a-4ec6-9208-3e44ee8f62af is already attached to instances: 74a2fff2-0034-437f-be7e-bcba679c0b2f Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:38:00.626436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4d101ea9-0a2a-4ec6-9208-3e44ee8f62af is already attached to instances: 74a2fff2-0034-437f-be7e-bcba679c0b2f Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 400 to user: Invalid volume: volume 4d101ea9-0a2a-4ec6-9208-3e44ee8f62af is already attached to instances: 74a2fff2-0034-437f-be7e-bcba679c0b2f {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:38:00.628670 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a5005b31-6be5-458d-8cc8-7a076e75f749 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142241 Jul 27 15:38:00.630132 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 477/957] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:38:00 2022] POST /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:38:00.708971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:00.709958 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:00.720735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:00.721181 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:00.721959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:00.722425 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:00.840682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lazy-loading 'services' on Instance uuid 74a2fff2-0034-437f-be7e-bcba679c0b2f {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:38:00.936088 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c4065c06-11b2-44dd-a450-7d51495b225f tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments/4d101ea9-0a2a-4ec6-9208-3e44ee8f62af" status: 202 len: 0 microversion: 2.1 time: 0.231436 Jul 27 15:38:00.937087 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 481/958] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:38:00 2022] DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments/4d101ea9-0a2a-4ec6-9208-3e44ee8f62af => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:38:00.945639 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:00.948165 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:00.955725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:00.956448 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:00.957488 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:00.958276 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:01.011304 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f3960fb9-ab87-4a42-a736-2a23dac65ea0 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069690 Jul 27 15:38:01.012250 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 478/959] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:38:00 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:38:02.030368 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:02.034527 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:02.043789 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:02.044629 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:02.047390 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:02.048139 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:02.082107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4e08e22c-7a25-4524-aca9-e4e928b9b49d tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060331 Jul 27 15:38:02.082912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 482/960] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:38:02 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:38:02.149435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:02.150028 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:02.157011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:02.157367 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:02.158134 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:02.158558 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:02.185544 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:38:02.272202 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08c6d971-7b3a-4d1c-869b-c1b377ba1b62 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 204 len: 0 microversion: 2.1 time: 0.126363 Jul 27 15:38:02.273592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 479/961] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:38:02 2022] DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:38:02.281966 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:02.282692 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:02.288777 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:02.289299 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:02.290141 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:02.290649 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:02.533782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:02.542229 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-286b95e1-4f1b-4834-a8b3-9bf3565ea89a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1680 microversion: 2.1 time: 0.264411 Jul 27 15:38:02.543097 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 483/962] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:02 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:03.566271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:03.567061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:03.573978 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:03.574428 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:03.583177 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:03.583906 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:03.802655 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:03.811382 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7db9f541-c5d3-48eb-a600-b7f93c03f644 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1680 microversion: 2.1 time: 0.250060 Jul 27 15:38:03.814124 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 480/963] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:03 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:04.837222 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:04.839174 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:04.857783 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:04.858507 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:04.859498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:04.860180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:05.540371 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-c3146cdd-7290-40be-9754-679b3e6b7324 req-a6d45414-f119-4d8a-939d-09d33f23b396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a2fff2-0034-437f-be7e-bcba679c0b2f", "name": "network-vif-deleted", "tag": "82a9f1b2-b04d-4236-b0ad-f4bacb75fe42"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:05.545815 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:05.563167 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c3146cdd-7290-40be-9754-679b3e6b7324 req-a6d45414-f119-4d8a-939d-09d33f23b396 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:05.563435 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-12fd60dd-4c71-4c76-be99-1b6fa5cc55a2 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 200 len: 1680 microversion: 2.1 time: 0.730103 Jul 27 15:38:05.564733 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c3146cdd-7290-40be-9754-679b3e6b7324 req-a6d45414-f119-4d8a-939d-09d33f23b396 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:05.565348 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 484/964] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:04 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 1680 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:05.610025 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-c3146cdd-7290-40be-9754-679b3e6b7324 req-a6d45414-f119-4d8a-939d-09d33f23b396 service nova] Creating event network-vif-deleted:82a9f1b2-b04d-4236-b0ad-f4bacb75fe42 for instance 74a2fff2-0034-437f-be7e-bcba679c0b2f on hv-cinder-84131 Jul 27 15:38:05.617959 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-c3146cdd-7290-40be-9754-679b3e6b7324 req-a6d45414-f119-4d8a-939d-09d33f23b396 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082734 Jul 27 15:38:05.618531 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 481/965] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:38:06.590498 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:06.591288 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:06.599574 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:06.600267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:06.601237 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:06.601798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:06.617426 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f HTTP/1.1 Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:38:06.618957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:38:06.620705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '74a2fff2-0034-437f-be7e-bcba679c0b2f'} Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:38:06.621663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:38:06.623194 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:38:06.624616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:38:06.624616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-62b462a5-7882-4a3e-b6eb-67bbcd33d344 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 404 len: 111 microversion: 2.1 time: 0.034132 Jul 27 15:38:06.624616 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 485/966] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:06 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:38:06.629942 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2b4ec87a-9b1b-42c8-b42e-0608caee7474 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '.version_select at 0x7f9fd397c1f0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:06.649846 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2b4ec87a-9b1b-42c8-b42e-0608caee7474 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580740784" status: 202 len: 0 microversion: 2.1 time: 0.023967 Jul 27 15:38:06.650434 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 482/967] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Jul 27 15:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580740784 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:38:07.375494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0e65fb14-e0e4-48a3-8d6f-77ced8bd1beb tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: .version_select at 0x7f9fe03b78b0>, body: {"keypair": {"name": "tempest-keypair-272099682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2h8QzW6pe/ufQO2UNJhl7MeuBRpdB6tQ50DDcbNyjJVpMMgfJsJ4JVgLcBuicJWS9JBSSRxO7sST7F5I8kyleYwukncm5JiOFxWyMXHYb+g7VojH2/z62851h8BuQXFQ=="}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:07.392922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-0e65fb14-e0e4-48a3-8d6f-77ced8bd1beb tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:38:07.397249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-0e65fb14-e0e4-48a3-8d6f-77ced8bd1beb tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'key_pairs'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:38:07.434439 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0e65fb14-e0e4-48a3-8d6f-77ced8bd1beb tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062854 Jul 27 15:38:07.441084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 486/968] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:38:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:38:08.783992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1650929666", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb"}], "security_groups": [{"name": "tempest-securitygroup--1361268532"}], "key_name": "tempest-keypair-272099682", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:08.894284 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] validate_networks() for [('a2e8b8e4-20eb-4861-9f7d-a54b6571d6fb', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:38:09.264658 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:38:09.265589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:38:09.266064 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:38:09.266474 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:38:09.266883 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:38:09.276137 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:09.276590 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:09.277398 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:09.277836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:09.295546 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:38:09.299556 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Getting quotas for user 691d2cd293b244398bc9a3a98f1ad928 and project 33ea04cddf084bc9b4aab1e7c477abbf. Resources: {'cores', 'ram', 'instances'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:38:09.311088 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:38:09.313996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:38:09.361262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6348d6da-b319-46e3-8db7-d3b856d40eef tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.582569 Jul 27 15:38:09.361892 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 483/969] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:38:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:38:09.372964 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1dfc909f-e012-4f11-ac6f-acdd9910d21c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:09.373595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1dfc909f-e012-4f11-ac6f-acdd9910d21c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:09.429273 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1dfc909f-e012-4f11-ac6f-acdd9910d21c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:09.436186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1dfc909f-e012-4f11-ac6f-acdd9910d21c tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1241 microversion: 2.1 time: 0.067189 Jul 27 15:38:09.437267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 487/970] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:09 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:10.460087 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:10.460774 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:10.468677 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:10.469026 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:10.469807 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:10.470253 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:10.551565 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:10.559424 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-db8c5690-d08a-430a-88d9-8da55c3e5f05 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1299 microversion: 2.1 time: 0.105340 Jul 27 15:38:10.560036 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 484/971] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:10 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:11.580987 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:11.581604 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:11.588132 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:11.588587 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:11.589367 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:11.589813 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:11.727059 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:11.734843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-80eadf87-05d7-49b7-8598-fa01bb402f03 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.158275 Jul 27 15:38:11.735441 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 488/972] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:11 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:12.120033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-3a5858b9-3aad-4454-8c3a-80c79431ea14 req-a9bbfa0d-e61f-41fb-aff6-196298c6dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9b6d33-fc2d-425a-b079-6937682edee5", "tag": "121a7972-1d97-4e0c-b943-cdd6fbc24c85"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:12.137188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3a5858b9-3aad-4454-8c3a-80c79431ea14 req-a9bbfa0d-e61f-41fb-aff6-196298c6dd94 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:12.137925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3a5858b9-3aad-4454-8c3a-80c79431ea14 req-a9bbfa0d-e61f-41fb-aff6-196298c6dd94 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:12.160671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-3a5858b9-3aad-4454-8c3a-80c79431ea14 req-a9bbfa0d-e61f-41fb-aff6-196298c6dd94 service nova] Creating event network-changed:121a7972-1d97-4e0c-b943-cdd6fbc24c85 for instance 9b9b6d33-fc2d-425a-b079-6937682edee5 on hv-cinder-84131 Jul 27 15:38:12.165583 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-3a5858b9-3aad-4454-8c3a-80c79431ea14 req-a9bbfa0d-e61f-41fb-aff6-196298c6dd94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052022 Jul 27 15:38:12.166328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 485/973] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:38:12.754922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:12.755534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:12.762219 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:12.762663 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:12.763423 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:12.763872 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:12.901819 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:12.909924 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-95dbed62-8f92-4a47-a12b-792a298946dc tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.158905 Jul 27 15:38:12.910484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 489/974] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:12 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:13.932431 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:13.933052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:13.939812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:13.940281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:13.941044 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:13.941484 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:14.081151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:14.090555 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c8826452-9ae4-48b8-b5a1-5e06b3e57ee6 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.163404 Jul 27 15:38:14.091256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 486/975] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:13 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:38:15.114635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:15.115247 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:15.121853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:15.122334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:15.123093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:15.123623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:15.251336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:15.258668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1067498a-9b79-414a-9c89-db75f3780b47 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.147828 Jul 27 15:38:15.259234 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 490/976] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:15 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:16.280576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:16.281131 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:16.287782 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:16.288258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:16.289014 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:16.289444 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:16.426765 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:16.434634 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c1ce980f-e9db-43c1-bd13-8b1f677ed922 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.158496 Jul 27 15:38:16.435241 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 487/977] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:16 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:16.853418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-1ee46c3f-f17f-46bf-8eeb-1f3d4bcabd7e req-43babecb-34cc-4232-bb50-a98fb5bbac28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9b6d33-fc2d-425a-b079-6937682edee5", "name": "network-vif-plugged", "status": "completed", "tag": "121a7972-1d97-4e0c-b943-cdd6fbc24c85"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:16.865322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-1ee46c3f-f17f-46bf-8eeb-1f3d4bcabd7e req-43babecb-34cc-4232-bb50-a98fb5bbac28 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:16.865812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-1ee46c3f-f17f-46bf-8eeb-1f3d4bcabd7e req-43babecb-34cc-4232-bb50-a98fb5bbac28 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:16.880356 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-1ee46c3f-f17f-46bf-8eeb-1f3d4bcabd7e req-43babecb-34cc-4232-bb50-a98fb5bbac28 service nova] Creating event network-vif-plugged:121a7972-1d97-4e0c-b943-cdd6fbc24c85 for instance 9b9b6d33-fc2d-425a-b079-6937682edee5 on hv-cinder-84131 Jul 27 15:38:16.885577 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-1ee46c3f-f17f-46bf-8eeb-1f3d4bcabd7e req-43babecb-34cc-4232-bb50-a98fb5bbac28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Jul 27 15:38:16.886216 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 491/978] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:38:17.456376 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:17.457010 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:17.463756 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:17.464230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:17.465013 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:17.465459 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:17.612148 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:17.619925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8c5309d3-3c26-4493-b518-fae9d36844c1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.168089 Jul 27 15:38:17.620493 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 488/979] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:17 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:18.642945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:18.643629 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:18.650373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:18.650817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:18.651568 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:18.652023 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:18.790011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:18.799384 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-424a7f05-4996-4224-9a03-16f9fca2aeed tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1367 microversion: 2.1 time: 0.161923 Jul 27 15:38:18.800035 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 492/980] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:18 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:19.820852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:19.821461 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:19.823893 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:19.824557 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:19.831278 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:19.831764 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:19.832540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:19.832975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:19.965150 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:38:19.972774 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1a12efbb-5b46-45de-94cd-65677c0be98b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1558 microversion: 2.1 time: 0.155748 Jul 27 15:38:19.973328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 489/981] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:38:19 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:38:19.992421 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:19.992918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:19.994864 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:20.001058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:20.001502 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:20.002257 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:20.002691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:20.083065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1efbc96b-8712-41ec-a5f1-e9c9a02f6190 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094376 Jul 27 15:38:20.083655 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 493/982] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Jul 27 15:38:19 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:38:21.022921 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-e13df313-892c-4194-b40c-d8cfcd01ac83 req-d3332d1c-2c8b-4a50-aaa1-77e16258542f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9b6d33-fc2d-425a-b079-6937682edee5", "tag": "121a7972-1d97-4e0c-b943-cdd6fbc24c85"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:21.033425 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-e13df313-892c-4194-b40c-d8cfcd01ac83 req-d3332d1c-2c8b-4a50-aaa1-77e16258542f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:21.034199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-e13df313-892c-4194-b40c-d8cfcd01ac83 req-d3332d1c-2c8b-4a50-aaa1-77e16258542f service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:21.045213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-e13df313-892c-4194-b40c-d8cfcd01ac83 req-d3332d1c-2c8b-4a50-aaa1-77e16258542f service nova] Creating event network-changed:121a7972-1d97-4e0c-b943-cdd6fbc24c85 for instance 9b9b6d33-fc2d-425a-b079-6937682edee5 on hv-cinder-84131 Jul 27 15:38:21.050271 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-e13df313-892c-4194-b40c-d8cfcd01ac83 req-d3332d1c-2c8b-4a50-aaa1-77e16258542f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030975 Jul 27 15:38:21.050875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 490/983] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:38:57.133664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:57.134469 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:57.138859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:38:57.139351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:57.147084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:57.147536 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:57.148397 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:57.148835 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:57.173589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4ce79f39-e496-44fa-b44e-a181ef83deea tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/ips" status: 200 len: 151 microversion: 2.1 time: 0.041409 Jul 27 15:38:57.174158 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 494/984] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Jul 27 15:38:57 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:38:58.520811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:58.521536 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:58.526243 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3912781-e882-4193-8133-d1544de14700"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:38:58.529281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:38:58.538119 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:58.538563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:58.539313 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:38:58.539744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:38:59.165816 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ba3e858a-abbe-476b-9b1c-84d125cd2707 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "POST /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646427 Jul 27 15:38:59.166787 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 491/985] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:38:58 2022] POST /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:39:06.817365 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:06.817985 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:06.824512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:06.824972 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:06.825814 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:06.826258 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:06.970408 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lazy-loading 'services' on Instance uuid 9b9b6d33-fc2d-425a-b079-6937682edee5 {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:39:07.046185 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-96ea2b16-30cc-4c29-a1ce-8cc5a57ba83a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments/e3912781-e882-4193-8133-d1544de14700" status: 202 len: 0 microversion: 2.1 time: 0.232455 Jul 27 15:39:07.046766 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 495/986] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:39:06 2022] DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments/e3912781-e882-4193-8133-d1544de14700 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:39:07.055988 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:07.058354 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:07.065712 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:07.066169 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:07.066952 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:07.067386 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:07.099850 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e0fe0166-fe82-4e7d-af47-c3222999ed52 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048381 Jul 27 15:39:07.100411 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 492/987] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:39:07 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:39:08.113757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:08.115978 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:08.122788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:08.123228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:08.124011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:08.124443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:08.154714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-fde7d552-a935-4377-a7c5-50e605ebba87 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045964 Jul 27 15:39:08.155273 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 496/988] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:39:08 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:39:08.217673 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:08.218232 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:08.224691 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:08.225143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:08.225909 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:08.226348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:08.253008 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:39:08.333541 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-16ca50f9-cd18-498e-aebb-8efde21c8e32 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 204 len: 0 microversion: 2.1 time: 0.119511 Jul 27 15:39:08.334125 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 493/989] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:39:08 2022] DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:39:08.342716 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:08.343353 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:08.350303 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:08.350757 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:08.351532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:08.352010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:08.484550 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:08.492002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-944c9577-41c8-4081-91e8-fa1b8e161c70 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1683 microversion: 2.1 time: 0.153272 Jul 27 15:39:08.492558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 497/990] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:08 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:09.514744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:09.515482 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:09.522112 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:09.522564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:09.523329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:09.523770 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:09.658421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:09.666030 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0e400034-56c8-4d9d-a0a5-13b0f48cf832 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1683 microversion: 2.1 time: 0.155604 Jul 27 15:39:09.666592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 494/991] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:09 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:10.688235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:10.688950 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:10.696041 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:10.696486 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:10.697250 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:10.697679 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:10.776851 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691d2cd293b244398bc9a3a98f1ad928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea04cddf084bc9b4aab1e7c477abbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:10.788638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-2f08f174-7e20-4fb6-89b8-99c877d14fe8 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 200 len: 1615 microversion: 2.1 time: 0.104861 Jul 27 15:39:10.789816 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 498/992] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:10 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:11.096731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-7873e27e-5392-4aa4-a185-6e7e8ec1da5b req-bd76185a-a499-4b9b-a842-15a581bbf172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9b6d33-fc2d-425a-b079-6937682edee5", "name": "network-vif-deleted", "tag": "121a7972-1d97-4e0c-b943-cdd6fbc24c85"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:39:11.109083 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7873e27e-5392-4aa4-a185-6e7e8ec1da5b req-bd76185a-a499-4b9b-a842-15a581bbf172 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:11.109575 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7873e27e-5392-4aa4-a185-6e7e8ec1da5b req-bd76185a-a499-4b9b-a842-15a581bbf172 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:11.127823 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-7873e27e-5392-4aa4-a185-6e7e8ec1da5b req-bd76185a-a499-4b9b-a842-15a581bbf172 service nova] Creating event network-vif-deleted:121a7972-1d97-4e0c-b943-cdd6fbc24c85 for instance 9b9b6d33-fc2d-425a-b079-6937682edee5 on hv-cinder-84131 Jul 27 15:39:11.132820 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-7873e27e-5392-4aa4-a185-6e7e8ec1da5b req-bd76185a-a499-4b9b-a842-15a581bbf172 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116507 Jul 27 15:39:11.136812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 495/993] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:39:11.810676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:11.811284 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:11.817912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:11.818351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:11.819112 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:11.819545 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:11.836473 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 HTTP/1.1 Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:39:11.838326 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:11.840103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '9b9b6d33-fc2d-425a-b079-6937682edee5'} Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:11.841631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:11.843296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:11.844751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:11.844751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-af2a47b8-6f71-4180-b950-177f1495fa09 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 404 len: 111 microversion: 2.1 time: 0.033294 Jul 27 15:39:11.844751 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 499/994] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:11 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:11.851079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-111cb19a-e2e6-477c-b2a2-f686fffe753b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '.version_select at 0x7f9fd3b59040>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:11.871919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-111cb19a-e2e6-477c-b2a2-f686fffe753b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272099682" status: 202 len: 0 microversion: 2.1 time: 0.025118 Jul 27 15:39:11.872611 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 496/995] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Jul 27 15:39:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272099682 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:39:13.665460 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:13.666012 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:13.672988 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:13.673432 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:13.674199 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:13.674638 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:13.689193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 HTTP/1.1 Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:39:13.690739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.692461 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '9b9b6d33-fc2d-425a-b079-6937682edee5'} Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:13.693371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.694826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.696336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:13.696336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-53a86fb8-34ce-48f4-88ab-477cb53379de tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 404 len: 111 microversion: 2.1 time: 0.030567 Jul 27 15:39:13.696336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 500/996] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:39:13 2022] DELETE /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:13.701292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:13.702061 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 9b9b6d33-fc2d-425a-b079-6937682edee5] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:13.708836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:13.709288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:13.710052 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:13.710490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:13.724038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 HTTP/1.1 Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:39:13.725700 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.727262 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '9b9b6d33-fc2d-425a-b079-6937682edee5'} Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:13.728157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. Jul 27 15:39:13.729387 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:13.730495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 9b9b6d33-fc2d-425a-b079-6937682edee5 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:13.730495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb58ed9e-d358-4c72-9cfc-7a56d0718f5a tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5" status: 404 len: 111 microversion: 2.1 time: 0.030207 Jul 27 15:39:13.730495 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 497/997] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:13 2022] GET /compute/v2.1/servers/9b9b6d33-fc2d-425a-b079-6937682edee5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:39:14.871655 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:14.872539 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:14.879534 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.880017 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.880788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.881228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.894902 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f HTTP/1.1 Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:39:14.896503 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.898116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '74a2fff2-0034-437f-be7e-bcba679c0b2f'} Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:14.898968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.900676 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.902241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:14.902241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-f2c41a25-d192-474d-b347-c5e581f4be88 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 404 len: 111 microversion: 2.1 time: 0.030171 Jul 27 15:39:14.902241 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 501/998] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:39:14 2022] DELETE /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:14.906652 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:14.907267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 74a2fff2-0034-437f-be7e-bcba679c0b2f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:14.913803 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.914248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.915011 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.915445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.929883 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f HTTP/1.1 Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:39:14.931414 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.933186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '74a2fff2-0034-437f-be7e-bcba679c0b2f'} Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:14.934079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. Jul 27 15:39:14.935539 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.937442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 74a2fff2-0034-437f-be7e-bcba679c0b2f could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:14.937442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-047868df-5ec3-4cd2-828c-10d05ee215f1 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f" status: 404 len: 111 microversion: 2.1 time: 0.030061 Jul 27 15:39:14.937442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 498/999] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:14 2022] GET /compute/v2.1/servers/74a2fff2-0034-437f-be7e-bcba679c0b2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:14.941868 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:14.942362 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:14.948418 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.948867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.949631 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.950064 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.963914 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 HTTP/1.1 Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:39:14.965462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:14.967065 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'dc517287-de76-4a17-94aa-a47eb0588266'} Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:14.967997 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:14.969489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:14.970959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:14.970959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4843cf5f-2dd9-4283-98e5-20568b6acb6b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 404 len: 111 microversion: 2.1 time: 0.028760 Jul 27 15:39:14.970959 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 502/1000] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:39:14 2022] DELETE /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:14.975681 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:14.976197 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: dc517287-de76-4a17-94aa-a47eb0588266] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:14.982436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.983444 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:14.984301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:14.984738 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:15.000545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 HTTP/1.1 Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:39:15.003242 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:15.004963 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'dc517287-de76-4a17-94aa-a47eb0588266'} Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:15.005895 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. Jul 27 15:39:15.007256 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:15.008615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance dc517287-de76-4a17-94aa-a47eb0588266 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:15.008615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6c3ff806-1ba4-462b-b0e5-92c5f7d05f0b tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266" status: 404 len: 111 microversion: 2.1 time: 0.033857 Jul 27 15:39:15.008615 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 499/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:14 2022] GET /compute/v2.1/servers/dc517287-de76-4a17-94aa-a47eb0588266 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:16.144160 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:16.144791 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:16.150927 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:16.151372 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:16.152168 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:16.152607 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:16.165687 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 HTTP/1.1 Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:39:16.167201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.168817 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '601af892-ad4b-4797-8590-70c82bc772c3'} Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:16.169612 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.171161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.172729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:16.172729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8a965ee5-5d32-4e25-8ee6-1246c60a1091 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 404 len: 111 microversion: 2.1 time: 0.028270 Jul 27 15:39:16.172729 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 503/1002] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:39:16 2022] DELETE /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:16.177186 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:16.177790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] [instance: 601af892-ad4b-4797-8590-70c82bc772c3] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:16.184995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:16.185440 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:16.186777 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:16.187328 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:16.202881 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] HTTP exception thrown: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Request method failure captured: Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 HTTP/1.1 Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4VsJOoioBqo2mg102FfdavMy48ZVVwVB-eO89_RvWHp1uBpi97qrsLpji2HOOflXWiTJd7kbubp_r_6p4pkMIFoRXRbWzxnY-8EKPHpGKcpP8B79u-5zfNE5ktrnoHktURiefkTMw7jtnkM_MO6lwo8eNtZAJTGVgQp6JUf997DOq28 Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:39:16.204511 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33ea04cddf084bc9b4aab1e7c477abbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33ea04cddf084bc9b4aab1e7c477abbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 33ea04cddf084bc9b4aab1e7c477abbf Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298379223 Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 691d2cd293b244398bc9a3a98f1ad928 Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1298379223-project Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.206151 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': '601af892-ad4b-4797-8590-70c82bc772c3'} Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:16.206984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. Jul 27 15:39:16.208289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:16.209416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] Returning 404 to user: Instance 601af892-ad4b-4797-8590-70c82bc772c3 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:16.209416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e003e3f5-75bf-4277-a663-27a54b10dff5 tempest-AttachVolumeNegativeTest-1298379223 tempest-AttachVolumeNegativeTest-1298379223-project] 10.222.0.36 "GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3" status: 404 len: 111 microversion: 2.1 time: 0.032487 Jul 27 15:39:16.209416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 500/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:16 2022] GET /compute/v2.1/servers/601af892-ad4b-4797-8590-70c82bc772c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:36.261273 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1073415626", "imageRef": "d0f25e47-13cd-4e4a-b506-7f67af5556d6", "flavorRef": "452"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:39:36.269109 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=20 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:36.269760 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:36.316267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] validate_networks() for None {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:39:36.839058 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:39:36.839471 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:39:36.839974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:39:36.840375 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:39:36.840778 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:39:36.849899 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:36.850337 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:36.851121 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:36.851549 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:36.868754 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Getting quotas for project cadc46b48c824bfba28a4ecfb434e701. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:39:36.873028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Getting quotas for user 0269589b89e6471183b5a73dc5eebae9 and project cadc46b48c824bfba28a4ecfb434e701. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:39:36.888842 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:39:36.891269 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0f25e47-13cd-4e4a-b506-7f67af5556d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:39:36.946823 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-dfc118d1-b437-47ab-b9d8-6a8cbe2c7e68 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689354 Jul 27 15:39:36.947484 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 504/1004] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:39:36.958508 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88cfe1cf-b098-4ddd-8c4f-2dc42f0b940d tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:36.959120 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-88cfe1cf-b098-4ddd-8c4f-2dc42f0b940d tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:36.962289 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:36.962936 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:37.025157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88cfe1cf-b098-4ddd-8c4f-2dc42f0b940d tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:37.033497 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88cfe1cf-b098-4ddd-8c4f-2dc42f0b940d tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1215 microversion: 2.1 time: 0.078813 Jul 27 15:39:37.034129 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 501/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:36 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:38.056697 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:38.057306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:38.064698 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:38.065153 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:38.065934 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:38.066373 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:38.139957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:38.148062 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4290ce54-660f-488c-bfd1-fa46ec50521b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1275 microversion: 2.1 time: 0.095964 Jul 27 15:39:38.148644 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 505/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:38 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:39.169326 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:39.170010 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:39.176092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:39.176550 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:39.177586 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:39.178068 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:39.403814 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:39.411455 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-07b16d43-1dd7-4570-af0b-f2ae4236287b tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.246254 Jul 27 15:39:39.412055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 502/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:39 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:39:39.914311 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-20f0db36-998b-45dc-94cc-7d10db46e8b8 req-2a009507-85d1-4e01-a6b2-949b30136678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36ec755-9f48-4fd1-b019-b4c1fb787a7b", "tag": "d4ecf2bd-d571-408b-bd90-e14d9769b7ab"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:39:39.944839 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-20f0db36-998b-45dc-94cc-7d10db46e8b8 req-2a009507-85d1-4e01-a6b2-949b30136678 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:39.948034 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-20f0db36-998b-45dc-94cc-7d10db46e8b8 req-2a009507-85d1-4e01-a6b2-949b30136678 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:39.961299 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-20f0db36-998b-45dc-94cc-7d10db46e8b8 req-2a009507-85d1-4e01-a6b2-949b30136678 service nova] Creating event network-changed:d4ecf2bd-d571-408b-bd90-e14d9769b7ab for instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b on hv-cinder-84131 Jul 27 15:39:39.967642 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-20f0db36-998b-45dc-94cc-7d10db46e8b8 req-2a009507-85d1-4e01-a6b2-949b30136678 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057921 Jul 27 15:39:39.969056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 506/1008] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:39:40.436727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:40.437260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:40.443957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:40.444409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:40.445179 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:40.445624 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:40.578810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:40.586443 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a32bb8af-9411-42c7-bc23-f1073a187786 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.156134 Jul 27 15:39:40.587191 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 503/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:40 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:41.610886 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:41.611589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:41.618489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:41.618942 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:41.619733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:41.620226 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:41.770009 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:41.778067 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e043830c-1a39-4abc-9ce0-1e2d972b56d2 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.172452 Jul 27 15:39:41.778657 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 507/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:41 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:42.799272 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:42.799903 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:42.806732 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:42.807173 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:42.807957 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:42.808386 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:42.942915 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:42.951089 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9fb80073-2612-4f74-af2f-f68b7a4c85d9 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.156131 Jul 27 15:39:42.951716 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 504/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:42 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:43.971857 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:43.972475 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:43.979137 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:43.979589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:43.980410 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:43.980857 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:44.118940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:44.127443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8e1c29f8-391a-4650-9aab-0b167f0f4255 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.159420 Jul 27 15:39:44.128166 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 508/1012] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:43 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:39:45.150591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:45.151255 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:45.158658 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:45.159105 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:45.159968 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:45.160408 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:45.318587 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:45.327869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-48071a50-500d-4146-8891-aecdf680d79f tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.181078 Jul 27 15:39:45.331880 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 505/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:45 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:45.453589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-e4f9e324-b988-4592-bcf3-ddf88406aa33 req-1c7a6031-d152-4d38-9448-d9b9391cbcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36ec755-9f48-4fd1-b019-b4c1fb787a7b", "name": "network-vif-plugged", "status": "completed", "tag": "d4ecf2bd-d571-408b-bd90-e14d9769b7ab"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:39:45.463234 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-e4f9e324-b988-4592-bcf3-ddf88406aa33 req-1c7a6031-d152-4d38-9448-d9b9391cbcb8 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:45.463660 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-e4f9e324-b988-4592-bcf3-ddf88406aa33 req-1c7a6031-d152-4d38-9448-d9b9391cbcb8 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:45.475062 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-e4f9e324-b988-4592-bcf3-ddf88406aa33 req-1c7a6031-d152-4d38-9448-d9b9391cbcb8 service nova] Creating event network-vif-plugged:d4ecf2bd-d571-408b-bd90-e14d9769b7ab for instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b on hv-cinder-84131 Jul 27 15:39:45.480167 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-e4f9e324-b988-4592-bcf3-ddf88406aa33 req-1c7a6031-d152-4d38-9448-d9b9391cbcb8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174594 Jul 27 15:39:45.480769 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 509/1014] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:39:46.349736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:46.350415 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:46.357417 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:46.357869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:46.358644 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:46.359085 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:46.496334 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:46.504002 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9f72f603-aa14-43d1-add7-de296121cf64 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1315 microversion: 2.1 time: 0.158121 Jul 27 15:39:46.504591 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 506/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:46 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:47.522805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:47.523584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:47.527952 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:47.528661 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:47.536506 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:47.536983 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:47.537752 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:47.538191 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:47.675916 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:47.683968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b00037eb-31eb-42d5-9b7d-326af8c9b463 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1464 microversion: 2.1 time: 0.162512 Jul 27 15:39:47.684552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 510/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:47 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:47.729019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:47.729547 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:47.731456 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:47.737922 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:47.738374 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:47.739152 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:47.739592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:47.766249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:39:47.845235 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c4988eef-d614-4f54-a3f2-a149b00f7c16 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 204 len: 0 microversion: 2.1 time: 0.119477 Jul 27 15:39:47.846143 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 507/1017] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:39:47 2022] DELETE /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:39:47.855032 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:47.855635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:47.861683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:47.862125 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:47.862885 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:47.863314 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:47.997321 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:48.005220 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1e3fc625-b5ae-4a2b-9900-11c5f29acde8 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1470 microversion: 2.1 time: 0.153948 Jul 27 15:39:48.005783 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 511/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:47 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:49.027545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:49.028270 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:49.035336 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.035782 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.036581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.037018 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.172675 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:49.180490 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-83c62648-ca79-4461-be76-6ff1f34c9a47 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1470 microversion: 2.1 time: 0.157154 Jul 27 15:39:49.181063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 508/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:49 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:49.274489 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:39:49.275084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:49.282186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.282636 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.283406 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.283853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.308354 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lazy-loading 'flavor' on Instance uuid c7840eb4-8d99-45cb-9386-62ee3acea42b {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:39:49.402417 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e683c168-1f05-497b-abeb-35d659dd9253 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "POST /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b/action" status: 202 len: 0 microversion: 2.1 time: 0.131621 Jul 27 15:39:49.403098 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 512/1020] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:39:49 2022] POST /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:39:49.414678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:49.415311 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:49.426337 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.426789 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.427871 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.428318 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.651674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:49.660095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-731421ef-68ef-4d38-804a-ce281b368d0e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.249291 Jul 27 15:39:49.660703 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 509/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:49 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:49.911867 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-55bbdabc-31f7-4383-afd8-682d95642f4b req-79668822-c33c-4638-8946-a45bc68abbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36ec755-9f48-4fd1-b019-b4c1fb787a7b", "name": "network-vif-deleted", "tag": "d4ecf2bd-d571-408b-bd90-e14d9769b7ab"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:39:49.922826 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-55bbdabc-31f7-4383-afd8-682d95642f4b req-79668822-c33c-4638-8946-a45bc68abbd4 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:49.923268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-55bbdabc-31f7-4383-afd8-682d95642f4b req-79668822-c33c-4638-8946-a45bc68abbd4 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:49.936797 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-55bbdabc-31f7-4383-afd8-682d95642f4b req-79668822-c33c-4638-8946-a45bc68abbd4 service nova] Creating event network-vif-deleted:d4ecf2bd-d571-408b-bd90-e14d9769b7ab for instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b on hv-cinder-84131 Jul 27 15:39:49.942669 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-55bbdabc-31f7-4383-afd8-682d95642f4b req-79668822-c33c-4638-8946-a45bc68abbd4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034737 Jul 27 15:39:49.943267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 513/1022] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:39:50.203216 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:50.203771 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:50.210268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:50.210714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:50.211476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:50.211940 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:50.244272 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:50.244720 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:50.245172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lazy-loading 'fault' on Instance uuid b36ec755-9f48-4fd1-b019-b4c1fb787a7b {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:39:50.292841 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0269589b89e6471183b5a73dc5eebae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadc46b48c824bfba28a4ecfb434e701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:50.300855 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-232c9df6-a502-47ae-b715-a63d0795d8cd tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 200 len: 1305 microversion: 2.1 time: 0.102128 Jul 27 15:39:50.301445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 510/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:50 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:50.681708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:50.682403 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:50.689303 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:50.689748 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:50.690512 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:50.690940 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:50.829900 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:50.837555 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ab150904-d0fe-4106-9bd2-1f633d696f96 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.160729 Jul 27 15:39:50.838229 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 514/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:50 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:51.323049 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:51.323607 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] [instance: b36ec755-9f48-4fd1-b019-b4c1fb787a7b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:51.330740 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:51.331203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:51.332001 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:51.332435 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:51.347996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] HTTP exception thrown: Instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b could not be found. Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Request method failure captured: Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b HTTP/1.1 Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Connection: close Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Host: 10.222.0.36 Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.10 Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABi4Vw2OtnxfeIYYobrSICSnsuUJfU7HLVm_hao-bnkCxO4OvP787zvXJhg5U-Bo7lf82oROIw6zAxbY9YjkYuzA3LS0YU0IdmRNVy_l-r8dAu9Kh7U--IJnQx_X_jg-bRJ21DZQvUz0l6IY_xUOYC4gy8lDphlzcihl11M675lEaZy-Gc Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Id: cadc46b48c824bfba28a4ecfb434e701 Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesNegativeTest-2015109775 Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Role: reader,member Jul 27 15:39:51.349668 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Roles: reader,member Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cadc46b48c824bfba28a4ecfb434e701"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cadc46b48c824bfba28a4ecfb434e701", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cadc46b48c824bfba28a4ecfb434e701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cadc46b48c824bfba28a4ecfb434e701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesNegativeTest-2015109775 Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Id: cadc46b48c824bfba28a4ecfb434e701 Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesNegativeTest-2015109775 Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesNegativeTest-2015109775-project Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Id: 0269589b89e6471183b5a73dc5eebae9 Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesNegativeTest-2015109775-project Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: method: > Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: exception: Instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b could not be found. Jul 27 15:39:51.351153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: action_args: {'id': 'b36ec755-9f48-4fd1-b019-b4c1fb787a7b'} Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b could not be found. Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:39:51.352063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b could not be found. Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b could not be found. Jul 27 15:39:51.354203 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 27 15:39:51.356731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] Returning 404 to user: Instance b36ec755-9f48-4fd1-b019-b4c1fb787a7b could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:39:51.356731 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-954aeeb7-06e1-471f-8140-e1e86bf9bef4 tempest-VolumesNegativeTest-2015109775 tempest-VolumesNegativeTest-2015109775-project] 10.222.0.36 "GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b" status: 404 len: 111 microversion: 2.1 time: 0.032592 Jul 27 15:39:51.357752 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 511/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:51 2022] GET /compute/v2.1/servers/b36ec755-9f48-4fd1-b019-b4c1fb787a7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:51.858682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:51.859292 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:51.868055 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:51.868500 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:51.869276 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:51.869711 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:52.023809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:52.032059 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-220c4880-b384-4f44-828b-6749180421d0 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.177238 Jul 27 15:39:52.032615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 515/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:51 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:53.053492 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:53.054105 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:53.060878 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:53.061323 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:53.062117 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:53.062576 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:53.207954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:53.215714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0ff509c0-a6cb-4ed4-9246-096308d1b8bf tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.166218 Jul 27 15:39:53.217004 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 512/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:53 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:54.241310 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:54.242121 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:54.248457 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:54.248913 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:54.249692 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:54.250129 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:54.416476 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:54.425165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-06d90fb4-ded4-4b66-bb88-2492f73abfdb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.187648 Jul 27 15:39:54.425796 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 516/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:54 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:55.447327 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:55.448240 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:55.455091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:55.455530 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:55.456329 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:55.456760 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:55.596267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:55.604446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f74270e2-ade1-4ba8-a4c5-d1ff23cf1761 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.160975 Jul 27 15:39:55.615852 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 513/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:55 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:56.627619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:56.628278 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:56.635271 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:56.635691 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:56.636613 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:56.637217 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:56.854739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:56.866238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9c650a8d-74c3-41a0-95b3-6590ba755f36 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.243295 Jul 27 15:39:56.866943 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 517/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:56 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:57.889172 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:57.891418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:57.899560 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:57.900050 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:57.901108 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:57.901696 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:58.100701 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:58.110581 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f98b5310-b7a3-4c31-87e4-5dd5dc88f935 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.225791 Jul 27 15:39:58.121444 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 514/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:57 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:39:59.132429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:39:59.133810 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:39:59.140985 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:59.141738 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:59.142707 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:39:59.143307 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:39:59.425919 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:39:59.438947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-54cf69cd-8a6d-4ab7-a32e-604fafcbc0fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.310317 Jul 27 15:39:59.445745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 518/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:39:59 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:00.462801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:00.463430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:00.470568 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:00.471357 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:00.472445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:00.473076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:00.661069 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:00.681247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d311e2fe-d219-4225-b13b-b37032579fa7 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.221925 Jul 27 15:40:00.683045 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 515/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:00 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:01.703513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:01.704231 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:01.711122 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:01.711661 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:01.712463 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:01.712974 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:01.902635 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:01.911582 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d39e931a-1331-4bbb-b1e9-54d5c9d608e4 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.211777 Jul 27 15:40:01.912252 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 519/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:01 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:02.937974 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:02.945169 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:02.962563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:02.964188 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:02.968055 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:02.968928 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:03.184217 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:03.194633 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-18dfc1b4-e059-4965-8bb5-7275bb390ff8 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1568 microversion: 2.1 time: 0.261136 Jul 27 15:40:03.195221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 516/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:02 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:03.216495 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:03.217093 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:03.224046 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:03.224494 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:03.225270 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:03.225701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:03.270188 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117869) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 15:40:03.319739 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:03.368809 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0bf8fd82-0c9c-4e19-bf46-d215563d8cc6 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "POST /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b/action" status: 202 len: 0 microversion: 2.1 time: 0.156783 Jul 27 15:40:03.374657 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 520/1036] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:40:03 2022] POST /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:40:03.378505 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:03.382637 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:03.398701 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:03.399249 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:03.400199 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:03.400715 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:03.412605 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:03.600927 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:03.611157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a817272b-52fa-4012-9266-3618a6e82f5d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1516 microversion: 2.1 time: 0.235917 Jul 27 15:40:03.625244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 517/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:03 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:04.635061 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:04.635702 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:04.645878 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:04.646335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:04.647126 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:04.647565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:05.038333 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:05.048755 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e920b5ab-9b59-4147-85b5-0cc3c6dc9c9e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1516 microversion: 2.1 time: 0.417962 Jul 27 15:40:05.049350 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 521/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:04 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1516 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:05.579810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-52ee51cd-bf9c-4b32-96f2-3df89f01dfe2 req-5c9d691d-7055-486c-a070-eff846e78d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "name": "network-vif-unplugged", "status": "completed", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:05.613919 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-52ee51cd-bf9c-4b32-96f2-3df89f01dfe2 req-5c9d691d-7055-486c-a070-eff846e78d92 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:05.614976 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-52ee51cd-bf9c-4b32-96f2-3df89f01dfe2 req-5c9d691d-7055-486c-a070-eff846e78d92 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:05.646810 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.compute.server_external_events [req-52ee51cd-bf9c-4b32-96f2-3df89f01dfe2 req-5c9d691d-7055-486c-a070-eff846e78d92 service nova] Unable to find a host for instance c7840eb4-8d99-45cb-9386-62ee3acea42b. Dropping event network-vif-unplugged {{(pid=117870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 15:40:05.649872 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-52ee51cd-bf9c-4b32-96f2-3df89f01dfe2 req-5c9d691d-7055-486c-a070-eff846e78d92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073657 Jul 27 15:40:05.651315 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 518/1039] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 15:40:06.071109 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:06.071735 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:06.086291 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:06.087054 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:06.088045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:06.088655 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:06.523454 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:06.535662 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-018f469a-f072-40a7-813a-499e3897e12d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.468359 Jul 27 15:40:06.537359 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 522/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:06 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:07.559678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:07.560333 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:07.566214 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:07.568642 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:07.569528 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:07.570651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:07.571276 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:07.736302 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:07.745874 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-25fb32f3-09d3-4fda-b1c6-4f057dd1f72f tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.190130 Jul 27 15:40:07.746968 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 519/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:07 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:08.770775 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:08.772158 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:08.774963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:08.782322 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:08.783090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:08.784235 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:08.784885 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:09.029098 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:09.038196 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b70d3273-bc34-4f76-96ae-81876bb6d30e tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.274280 Jul 27 15:40:09.039327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 523/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:08 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:10.060478 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:10.061094 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:10.071039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:10.072616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:10.074421 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:10.075332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:10.235800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:10.248063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-321b8082-a7b1-4184-91aa-04de76c823e5 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.191249 Jul 27 15:40:10.264540 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 520/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:10 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:11.272836 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:11.273443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:11.283558 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:11.284301 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:11.285233 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:11.285859 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:11.443393 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:11.452169 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b15c717b-8435-4875-94b0-a32de5444550 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.183430 Jul 27 15:40:11.466095 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 524/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:11 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:12.473617 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:12.474345 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:12.481408 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:12.482178 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:12.483162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:12.483674 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:12.635425 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:12.643766 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5e03cea9-28c0-4f6a-8031-f64d8bd436fb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.173933 Jul 27 15:40:12.645916 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 521/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:12 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:13.669630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:13.670228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:13.678107 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:13.681514 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:13.682965 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:13.684332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:13.863416 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:13.871707 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7a58551c-7ace-4bd7-a0ca-3a07685dde1d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.205350 Jul 27 15:40:13.872334 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 525/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:13 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:14.904159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:14.905442 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:14.913040 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:14.913618 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:14.914418 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:14.914857 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:15.079362 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:15.088307 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4e41eba2-95c2-49aa-b522-3f0037768865 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.188778 Jul 27 15:40:15.088679 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 522/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:14 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:16.112983 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:16.114415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:16.121268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:16.122090 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:16.123376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:16.123907 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:16.300091 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:16.309012 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-e85c4c65-acde-41dd-9b99-17dfe1c1cf88 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.200289 Jul 27 15:40:16.309619 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 526/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:16 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:16.900348 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-422b8286-fd22-4f12-8add-11a9768be89d tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Action: 'create', calling method: .version_select at 0x7f9fd3b6fb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1884849404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk2fXwD6itJa9GvDWxgHo6qw52sDVXaBDPvkLsPmPdmV/bPAK3aA+O/Gm4vBNav4Eld/+6ucVpwv6v8/LTK98ONRGuiTBWNxRf1q71xkF4oHhsG02HoV9ZqAGQQ092T0g=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:16.916054 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-422b8286-fd22-4f12-8add-11a9768be89d tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Getting quotas for project f40879b7ec11451a82501bf14592c04a. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:40:16.919916 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-422b8286-fd22-4f12-8add-11a9768be89d tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Getting quotas for user 658f2b944c994780b615b5c0affd4600 and project f40879b7ec11451a82501bf14592c04a. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:40:16.942041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-422b8286-fd22-4f12-8add-11a9768be89d tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045523 Jul 27 15:40:16.942821 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 523/1049] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Jul 27 15:40:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:16.994866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1714233647", "imageRef": "f7817a03-bd85-4972-861b-8e1ba6e1fd8a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1884849404", "networks": [{"uuid": "a9f2d62e-6002-4555-b49f-639cf150a235"}]}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:17.056025 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.network.neutron [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] validate_networks() for [('a9f2d62e-6002-4555-b49f-639cf150a235', None, None, None, None, None)] {{(pid=117869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 15:40:17.331074 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:17.332069 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:17.338292 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:17.338912 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:17.339801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:17.340364 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:17.482430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Flavor limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:40:17.482957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Image limits 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:40:17.483532 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Flavor pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:40:17.484071 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Image pref 0:0:0 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:40:17.484361 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.virt.hardware [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:40:17.487092 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:17.494483 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:17.495021 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:17.496229 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:17.496746 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:17.497073 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6eea2e73-2b9d-4e3f-93a5-6889640326e2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.170183 Jul 27 15:40:17.497840 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 524/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:17 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:17.520010 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Getting quotas for project f40879b7ec11451a82501bf14592c04a. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 15:40:17.521589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.quota [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Getting quotas for user 658f2b944c994780b615b5c0affd4600 and project f40879b7ec11451a82501bf14592c04a. Resources: {'cores', 'ram', 'instances'} {{(pid=117869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 15:40:17.524000 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-10830482-a953-4014-aeb4-11f14fdda7a1 req-4053f3a6-15f6-4215-96ba-aac3f5d2c96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "name": "network-vif-plugged", "status": "completed", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:17.534438 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Going to run 1 instances... {{(pid=117869) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 15:40:17.535033 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-10830482-a953-4014-aeb4-11f14fdda7a1 req-4053f3a6-15f6-4215-96ba-aac3f5d2c96c service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:17.535483 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-10830482-a953-4014-aeb4-11f14fdda7a1 req-4053f3a6-15f6-4215-96ba-aac3f5d2c96c service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:17.536893 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7817a03-bd85-4972-861b-8e1ba6e1fd8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 15:40:17.547707 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-10830482-a953-4014-aeb4-11f14fdda7a1 req-4053f3a6-15f6-4215-96ba-aac3f5d2c96c service nova] Creating event network-vif-plugged:89a43d90-e38e-4f3f-b165-519e1d370bb5 for instance c7840eb4-8d99-45cb-9386-62ee3acea42b on hv-cinder-84131 Jul 27 15:40:17.554056 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-10830482-a953-4014-aeb4-11f14fdda7a1 req-4053f3a6-15f6-4215-96ba-aac3f5d2c96c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 Jul 27 15:40:17.554580 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 525/1051] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:17.586803 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9943bf94-6cb4-45bd-9e4d-28ee772c3983 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595500 Jul 27 15:40:17.587447 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 527/1052] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Jul 27 15:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:40:17.600038 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1b5d7377-3fb5-4181-bd28-fc1c85e739dc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:17.600742 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1b5d7377-3fb5-4181-bd28-fc1c85e739dc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:17.658102 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1b5d7377-3fb5-4181-bd28-fc1c85e739dc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:17.666136 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1b5d7377-3fb5-4181-bd28-fc1c85e739dc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1259 microversion: 2.1 time: 0.071005 Jul 27 15:40:17.666727 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 526/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:17 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:18.527784 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:18.528371 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:18.535672 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:18.536139 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:18.536906 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:18.537331 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:18.677852 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:18.686201 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-1553a6d1-8195-478a-92e6-f05daff26acb tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1574 microversion: 2.1 time: 0.162328 Jul 27 15:40:18.686762 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 528/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:18 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:18.688905 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:18.689521 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:18.699162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:18.699614 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:18.700422 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:18.700850 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:18.766680 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:18.775001 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e04eafc7-1d4d-46dd-a6b9-875e8d250fc0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1311 microversion: 2.1 time: 0.089992 Jul 27 15:40:18.775572 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 527/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:18 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:40:19.707455 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:19.708305 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:19.715569 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:19.716306 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:19.717178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:19.717897 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:19.800898 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:19.802397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:19.811288 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:19.812017 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:19.812955 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:19.813725 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:19.869351 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:19.878918 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-a313a284-5d16-4092-b655-7ba7c11f0863 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1561 microversion: 2.1 time: 0.175666 Jul 27 15:40:19.881186 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 529/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:19 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:19.915260 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:19.928842 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1874714d-21aa-44b8-a915-d82bd24df5ce tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1317 microversion: 2.1 time: 0.134958 Jul 27 15:40:19.929433 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 528/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:19 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:20.950837 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:20.952192 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:20.959142 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:20.959584 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:20.960402 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:20.960834 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:21.116229 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:21.124678 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d548309f-15cc-47e3-bedb-4c43ae9ce026 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.177632 Jul 27 15:40:21.130715 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 530/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:20 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:22.149643 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:22.150213 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:22.157847 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:22.158295 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:22.159091 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:22.159616 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:22.313465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:22.330463 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1273c79a-8d14-4de6-bc72-85fc59a10c68 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.184682 Jul 27 15:40:22.342074 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 529/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:22 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:23.360121 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:23.361215 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:23.368621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:23.369270 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:23.370106 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:23.371270 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:23.528261 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:23.536675 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c33867f3-23f8-4265-9ee0-6ac189f5ed2c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.184098 Jul 27 15:40:23.537589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 531/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:23 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:24.559301 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:24.561931 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:24.568840 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:24.569291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:24.570054 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:24.570487 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:24.725259 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:24.734651 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e39b7afc-0ceb-44d6-b49b-a4f7bce1f96e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.180083 Jul 27 15:40:24.735564 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 530/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:24 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:25.758594 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:25.759240 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:25.767328 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:25.767864 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:25.768664 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:25.769101 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:25.931232 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:25.940349 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-96a6e294-8a98-48b3-acef-ded699584d4f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.186229 Jul 27 15:40:25.941128 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 532/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:25 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:26.961306 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:26.961935 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:26.968708 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:26.969153 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:26.969917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:26.970344 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:27.111678 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:27.119416 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7eb85f8b-75e1-4c4d-828c-893809ff9ca5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.162163 Jul 27 15:40:27.120021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 531/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:26 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:28.143127 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:28.144290 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:28.147109 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=2 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:28.148165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell0:SELECT=6 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:28.156731 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:28.157178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:28.157953 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:28.158387 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:28.206999 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-c3a3c44b-dd58-4ba0-8bb8-8fb5c7386a0c req-35abd044-82de-4398-87d3-5438e8dbd8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:28.221621 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:28.224836 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c3a3c44b-dd58-4ba0-8bb8-8fb5c7386a0c req-35abd044-82de-4398-87d3-5438e8dbd8f4 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:28.225240 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c3a3c44b-dd58-4ba0-8bb8-8fb5c7386a0c req-35abd044-82de-4398-87d3-5438e8dbd8f4 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:28.238485 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-c3a3c44b-dd58-4ba0-8bb8-8fb5c7386a0c req-35abd044-82de-4398-87d3-5438e8dbd8f4 service nova] Creating event network-changed:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:40:28.244824 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-c3a3c44b-dd58-4ba0-8bb8-8fb5c7386a0c req-35abd044-82de-4398-87d3-5438e8dbd8f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043172 Jul 27 15:40:28.246280 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 532/1064] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:28.326634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:28.335745 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-b72ef4f3-00da-4475-ba3d-60e244af7d5f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.197981 Jul 27 15:40:28.336429 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 533/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:28 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:29.357389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:29.358114 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:29.364613 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:29.365063 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:29.365828 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:29.366264 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:29.507244 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:29.515380 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3deb3153-8c6c-4cb1-a536-4cb586b7c5c3 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.162807 Jul 27 15:40:29.515975 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 533/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:29 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:30.536539 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:30.537163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:30.544462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:30.544912 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:30.545682 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:30.546116 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:30.678263 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:30.685901 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-8d933db4-f3c6-4748-a88c-5fb08b086fa5 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.153154 Jul 27 15:40:30.686478 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 534/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:30 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:31.707224 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:31.707868 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:31.715281 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:31.716593 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:31.717575 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:31.718017 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:31.863608 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:31.871389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1e67ed13-1900-45ac-ae77-a6d42c00650b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.168081 Jul 27 15:40:31.871910 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 534/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:31 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:32.892939 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:32.893552 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:32.900238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:32.900698 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:32.901482 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:32.901917 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:33.039623 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:33.047713 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4f29b973-6f4c-4b07-b009-b6b756b1dffc tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.158619 Jul 27 15:40:33.048307 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 535/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:32 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:33.522916 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-45bf2002-3641-4ed0-baf5-85896b154659 req-e57b2fae-478f-45f2-ad80-02ed4f1a059d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "name": "network-vif-plugged", "status": "completed", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:33.534065 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-45bf2002-3641-4ed0-baf5-85896b154659 req-e57b2fae-478f-45f2-ad80-02ed4f1a059d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:33.534509 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-45bf2002-3641-4ed0-baf5-85896b154659 req-e57b2fae-478f-45f2-ad80-02ed4f1a059d service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:33.538759 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=83 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:33.547676 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-45bf2002-3641-4ed0-baf5-85896b154659 req-e57b2fae-478f-45f2-ad80-02ed4f1a059d service nova] Creating event network-vif-plugged:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:40:33.552917 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-45bf2002-3641-4ed0-baf5-85896b154659 req-e57b2fae-478f-45f2-ad80-02ed4f1a059d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Jul 27 15:40:33.553736 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 535/1070] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:34.069661 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:34.070220 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:34.077361 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:34.077808 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:34.078565 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:34.078995 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:34.081625 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:34.212560 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:34.220163 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d826bf26-cf4b-4bd2-97f1-c7cd08e01f0c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1359 microversion: 2.1 time: 0.154384 Jul 27 15:40:34.220732 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 536/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:34 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:35.241986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:35.242714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:35.249122 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.249568 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.250340 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.250776 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.389952 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:35.397693 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-68a89903-54a3-4b2d-b803-41a7b140e21e tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1549 microversion: 2.1 time: 0.160402 Jul 27 15:40:35.398273 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 536/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:35 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:35.418621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:35.419228 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:35.426167 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.426621 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.427391 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.427856 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.561268 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:35.569178 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-cd479469-6c28-4207-912f-0e72aada56e6 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1549 microversion: 2.1 time: 0.154425 Jul 27 15:40:35.570112 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 537/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:35 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:35.592737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:35.597578 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:35.598380 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Searching by: {'deleted': False, 'project_id': 'f40879b7ec11451a82501bf14592c04a'} {{(pid=117870) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 27 15:40:35.606563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.606563 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.606995 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.607429 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.699248 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.multi_cell_list [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 15:40:35.798279 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-58c3f43a-ece7-46b3-a05e-ced16e3ddebf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212059 Jul 27 15:40:35.798880 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 537/1074] 10.222.0.36 () {58 vars in 1125 bytes} [Wed Jul 27 15:40:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:35.816266 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:35.816889 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:35.823238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.823690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.824511 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:35.824957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:35.971250 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:35.988380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9654518e-b401-4439-8cf1-63627def995f tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1549 microversion: 2.1 time: 0.177138 Jul 27 15:40:35.989308 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 538/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:35 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:37.578545 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a91905d-d6c6-4947-82d5-9efc13964c2a"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:37.580986 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:37.588317 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:37.588775 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:37.589554 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:37.589992 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:37.869041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0854e8ac-0b51-432b-912b-4b7ff3113b91 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294588 Jul 27 15:40:37.870132 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 538/1076] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Jul 27 15:40:37 2022] POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:44.410705 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:44.411320 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:44.413798 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:44.419119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:44.419589 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:44.420396 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:44.420812 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:44.555414 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:44.564138 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-37a4d855-7772-4683-835c-3156446d45d0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1595 microversion: 2.1 time: 0.157549 Jul 27 15:40:44.564724 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 539/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:44 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:46.310671 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:46.387780 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-4f0a2395-19f5-4ea9-a8bd-7fb4d4168c7e req-5114a62d-e9eb-440a-97a2-6d0bd5b13173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:46.393080 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:46.403783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-4f0a2395-19f5-4ea9-a8bd-7fb4d4168c7e req-5114a62d-e9eb-440a-97a2-6d0bd5b13173 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:46.403783 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-4f0a2395-19f5-4ea9-a8bd-7fb4d4168c7e req-5114a62d-e9eb-440a-97a2-6d0bd5b13173 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:46.415536 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-4f0a2395-19f5-4ea9-a8bd-7fb4d4168c7e req-5114a62d-e9eb-440a-97a2-6d0bd5b13173 service nova] Creating event network-changed:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:40:46.421258 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-4f0a2395-19f5-4ea9-a8bd-7fb4d4168c7e req-5114a62d-e9eb-440a-97a2-6d0bd5b13173 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111748 Jul 27 15:40:46.421744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 539/1078] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:40:47.474072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-770683507"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:47.475244 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:47.482843 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:47.483283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:47.484079 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:47.484709 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:47.617711 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.network.security_group_api [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Adding security group 9e892118-d7b7-4678-839d-856f80f040ce to port 6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 Jul 27 15:40:47.985154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-633b0028-e5c3-4922-8c06-c120a0d2513c tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/action" status: 202 len: 0 microversion: 2.1 time: 0.506708 Jul 27 15:40:47.988449 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 540/1079] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:40:47 2022] POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:40:47.997162 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:40:47.998430 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:40:48.005972 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:48.006465 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:48.007409 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:48.010798 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:48.186669 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:40:48.195966 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8c0cb821-41c2-481e-94b1-0bb6936f40c0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1759 microversion: 2.1 time: 0.203735 Jul 27 15:40:48.196559 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 540/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:40:47 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1759 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:40:48.437591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-4932b5ad-a761-4bb1-9f68-31c5dcda8f31 req-6bcad32c-8c93-482a-a8c7-80642f8f4f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:40:48.448573 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-4932b5ad-a761-4bb1-9f68-31c5dcda8f31 req-6bcad32c-8c93-482a-a8c7-80642f8f4f46 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:40:48.449133 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-4932b5ad-a761-4bb1-9f68-31c5dcda8f31 req-6bcad32c-8c93-482a-a8c7-80642f8f4f46 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:40:48.466267 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-4932b5ad-a761-4bb1-9f68-31c5dcda8f31 req-6bcad32c-8c93-482a-a8c7-80642f8f4f46 service nova] Creating event network-changed:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:40:48.472250 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-4932b5ad-a761-4bb1-9f68-31c5dcda8f31 req-6bcad32c-8c93-482a-a8c7-80642f8f4f46 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038764 Jul 27 15:40:48.472975 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 541/1081] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:41:13.825886 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:41:13.828218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:13.830352 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:13.831268 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:13.837702 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:13.838157 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:13.838944 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:13.839376 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:13.920550 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-68a00f94-ba56-4035-9d03-5e723882f9f0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/action" status: 202 len: 0 microversion: 2.1 time: 0.098588 Jul 27 15:41:13.924534 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 541/1082] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:41:13 2022] POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:41:13.931376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:13.931376 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:13.934273 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=5 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:13.934898 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=29 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:13.939615 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:13.940084 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:13.940884 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:13.941285 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:14.118412 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:14.126582 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-09dcc848-c38e-460e-9600-4139ced80531 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1751 microversion: 2.1 time: 0.200531 Jul 27 15:41:14.127377 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 542/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:13 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:15.149772 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:15.150389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:15.157375 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:15.157825 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:15.158597 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:15.159076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:15.307692 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:15.315721 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-415d5d7f-0f11-48c8-a422-9f06e07242cd tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.170320 Jul 27 15:41:15.316331 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 542/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:15 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:16.337238 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:16.337806 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:16.344487 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:16.344930 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:16.345690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:16.346119 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:16.496971 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:16.505002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-4430d04d-ace0-40da-9ee3-1aa8b0cd18ef tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.171682 Jul 27 15:41:16.505557 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 543/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:16 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:17.526499 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:17.527095 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:17.533741 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:17.534185 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:17.534949 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:17.535379 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:17.691332 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:17.700015 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e39626b5-4d66-4c48-8a15-bfa27959f968 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.177371 Jul 27 15:41:17.700589 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 543/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:17 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:18.720863 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:18.721470 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:18.728296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:18.728743 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:18.729510 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:18.729945 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:18.875888 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:18.885124 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-88445a30-2eb8-41bc-b6ac-ebecb199f99b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.168130 Jul 27 15:41:18.886002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 544/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:18 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:19.907218 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:19.907976 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:19.915216 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:19.915661 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:19.916446 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:19.916880 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:20.061286 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:20.069159 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-20281098-a950-41d3-b8f3-34160a7bdcc4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.166135 Jul 27 15:41:20.069714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 544/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:19 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:21.090517 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:21.091947 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:21.099154 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:21.099597 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:21.100378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:21.100808 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:21.242276 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:21.250102 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-c76cf1c8-1db1-4905-9ad2-97f86589733b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.163458 Jul 27 15:41:21.250659 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 545/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:21 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:22.272343 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:22.273601 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:22.280079 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:22.280522 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:22.281279 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:22.281712 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:22.424876 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:22.432773 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b05ccf4d-69c3-4480-bbce-790f75463be0 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.164932 Jul 27 15:41:22.433335 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 545/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:22 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:23.454505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:23.455092 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:23.461922 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:23.462378 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:23.463147 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:23.463593 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:23.602634 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:23.610505 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-0f2b363e-6ed7-49c9-8659-3dd305250363 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.159847 Jul 27 15:41:23.611068 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 546/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:23 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:24.632428 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:24.633027 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:24.640062 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:24.640510 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:24.641291 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:24.641722 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:24.798361 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:24.807255 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5ee56190-5b77-458b-b55e-f951537d46bf tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1756 microversion: 2.1 time: 0.178728 Jul 27 15:41:24.808020 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 546/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:24 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:41:25.828335 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:25.829002 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:25.837261 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:25.837701 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:25.838467 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:25.838903 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:25.989060 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:25.997885 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-9ff5c6c2-48ed-464f-b5b2-c8e43a20b05a tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1759 microversion: 2.1 time: 0.173715 Jul 27 15:41:25.998459 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 547/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:25 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:39.881737 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:39.882314 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:39.882957 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-99865ad9-f4de-40c3-b4f4-b56f8fcabf44 req-cde5477c-8023-4716-a29e-230a88cb0363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:41:39.885076 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=12 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:39.885857 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:39.893812 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:39.894117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=12 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:39.894698 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:39.895500 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:39.895624 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=36 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:39.896100 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:39.897805 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-99865ad9-f4de-40c3-b4f4-b56f8fcabf44 req-cde5477c-8023-4716-a29e-230a88cb0363 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:39.898313 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-99865ad9-f4de-40c3-b4f4-b56f8fcabf44 req-cde5477c-8023-4716-a29e-230a88cb0363 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:39.912354 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-99865ad9-f4de-40c3-b4f4-b56f8fcabf44 req-cde5477c-8023-4716-a29e-230a88cb0363 service nova] Creating event network-changed:89a43d90-e38e-4f3f-b165-519e1d370bb5 for instance c7840eb4-8d99-45cb-9386-62ee3acea42b on hv-cinder-84131 Jul 27 15:41:39.918474 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-99865ad9-f4de-40c3-b4f4-b56f8fcabf44 req-cde5477c-8023-4716-a29e-230a88cb0363 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039028 Jul 27 15:41:39.919249 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 548/1094] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:41:39.931261 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:41:40.024549 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1901eb09-4638-4131-9bbf-0b20d287ce43 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 204 len: 0 microversion: 2.1 time: 0.147337 Jul 27 15:41:40.028445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 547/1095] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:41:39 2022] DELETE /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:41:40.034259 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:40.034970 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:40.043327 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:40.043783 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:40.044600 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:40.045045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:40.188047 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:40.195782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-6706e02d-25a3-456a-8c0f-d060e010315d tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.166002 Jul 27 15:41:40.196384 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 549/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:40 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:41:41.217778 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:41.218389 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:41.225506 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:41.225954 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:41.226714 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:41.227156 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:41.687596 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:41.699402 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-26c2d712-b907-46c4-8c99-b6399a5d7b67 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1567 microversion: 2.1 time: 0.485476 Jul 27 15:41:41.700468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 548/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:41 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1567 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:42.439117 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-e92c4875-4a73-4bcd-a048-fbec0da7dd3f req-59d9c73d-c757-4eee-9b23-9ce5e1e65dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7840eb4-8d99-45cb-9386-62ee3acea42b", "name": "network-vif-deleted", "tag": "89a43d90-e38e-4f3f-b165-519e1d370bb5"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:41:42.452788 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-e92c4875-4a73-4bcd-a048-fbec0da7dd3f req-59d9c73d-c757-4eee-9b23-9ce5e1e65dcc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:42.453566 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-e92c4875-4a73-4bcd-a048-fbec0da7dd3f req-59d9c73d-c757-4eee-9b23-9ce5e1e65dcc service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:42.470972 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-e92c4875-4a73-4bcd-a048-fbec0da7dd3f req-59d9c73d-c757-4eee-9b23-9ce5e1e65dcc service nova] Creating event network-vif-deleted:89a43d90-e38e-4f3f-b165-519e1d370bb5 for instance c7840eb4-8d99-45cb-9386-62ee3acea42b on hv-cinder-84131 Jul 27 15:41:42.477415 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-e92c4875-4a73-4bcd-a048-fbec0da7dd3f req-59d9c73d-c757-4eee-9b23-9ce5e1e65dcc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041919 Jul 27 15:41:42.478023 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 550/1098] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:41:42.723890 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:42.724524 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:42.733555 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:42.734007 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:42.734781 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:42.735221 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:42.811659 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a42563c3d34a689c3cec947d649fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f420f7f5f5947088f23da2dab9f0fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:41:42.820869 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b42e3985-8546-4efe-98fb-a38473e66651 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 200 len: 1219 microversion: 2.1 time: 0.101020 Jul 27 15:41:42.826536 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 549/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:42 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:41:43.849111 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:43.849836 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] [instance: c7840eb4-8d99-45cb-9386-62ee3acea42b] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:41:43.856891 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:43.857336 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:43.858103 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:41:43.858540 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:41:43.872968 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] HTTP exception thrown: Instance c7840eb4-8d99-45cb-9386-62ee3acea42b could not be found. Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Request method failure captured: Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b HTTP/1.1 Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VuYZWKJnWt-HSRwtRJiDRkWK6BalLcA7YUyxvFx_4CrCMGmmo3ZfUXU2ulsZ3TvBcUj4VHectkur33bduLGBzFI3IY-fX7TCTiEikttDySRE9CJwrd_o2ZkMvJT4BTYjDZL00uURDxeSsI-0X9zvEunMd3Uz1hGMHm_XAMSNLaAffg Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: 1f420f7f5f5947088f23da2dab9f0fd7 Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-TestShelveInstance-1203599146 Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:41:43.874609 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f420f7f5f5947088f23da2dab9f0fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f420f7f5f5947088f23da2dab9f0fd7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f420f7f5f5947088f23da2dab9f0fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f420f7f5f5947088f23da2dab9f0fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-TestShelveInstance-1203599146 Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: 1f420f7f5f5947088f23da2dab9f0fd7 Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-TestShelveInstance-1203599146 Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-TestShelveInstance-1203599146-project Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 37a42563c3d34a689c3cec947d649fc1 Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-TestShelveInstance-1203599146-project Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance c7840eb4-8d99-45cb-9386-62ee3acea42b could not be found. Jul 27 15:41:43.876165 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': 'c7840eb4-8d99-45cb-9386-62ee3acea42b'} Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7840eb4-8d99-45cb-9386-62ee3acea42b could not be found. Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:41:43.877037 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7840eb4-8d99-45cb-9386-62ee3acea42b could not be found. Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7840eb4-8d99-45cb-9386-62ee3acea42b could not be found. Jul 27 15:41:43.878714 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:41:43.880164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Returning 404 to user: Instance c7840eb4-8d99-45cb-9386-62ee3acea42b could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:41:43.880164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-59c80e6f-6d75-4d77-b474-6e024d323c66 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b" status: 404 len: 111 microversion: 2.1 time: 0.031635 Jul 27 15:41:43.880164 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 551/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:41:43 2022] GET /compute/v2.1/servers/c7840eb4-8d99-45cb-9386-62ee3acea42b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:41:44.048074 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2677379-7a65-4e35-872f-14445490fbd2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] Calling method '.version_select at 0x7f9fd3c59280>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:41:44.069977 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a2677379-7a65-4e35-872f-14445490fbd2 tempest-TestShelveInstance-1203599146 tempest-TestShelveInstance-1203599146-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-408114322" status: 202 len: 0 microversion: 2.1 time: 0.025479 Jul 27 15:41:44.070925 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 550/1101] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Jul 27 15:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-408114322 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:42:01.078283 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-770683507"}} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:42:01.078866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:01.081028 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_api:SELECT=8 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:42:01.081667 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG dbcounter [-] [117869] Writing DB stats nova_cell1:SELECT=12 {{(pid=117869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:42:01.087522 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:01.088011 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:01.089295 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:01.089733 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:01.215513 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.network.security_group_api [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Removing security group 9e892118-d7b7-4678-839d-856f80f040ce from port 6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 Jul 27 15:42:01.550523 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-67cde191-fb50-426b-882b-1308145c9385 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/action" status: 202 len: 0 microversion: 2.1 time: 0.476170 Jul 27 15:42:01.551300 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 552/1102] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Jul 27 15:42:01 2022] POST /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:42:01.565388 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:42:01.566824 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:42:01.572099 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-1ce97687-2b52-4b50-a075-50cad125a72a req-66c3ddfe-cca5-48d9-ab51-4c68a27b0652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:42:01.597175 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1ce97687-2b52-4b50-a075-50cad125a72a req-66c3ddfe-cca5-48d9-ab51-4c68a27b0652 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:01.597924 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1ce97687-2b52-4b50-a075-50cad125a72a req-66c3ddfe-cca5-48d9-ab51-4c68a27b0652 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:01.610834 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-1ce97687-2b52-4b50-a075-50cad125a72a req-66c3ddfe-cca5-48d9-ab51-4c68a27b0652 service nova] Creating event network-changed:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:42:01.617875 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-1ce97687-2b52-4b50-a075-50cad125a72a req-66c3ddfe-cca5-48d9-ab51-4c68a27b0652 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053075 Jul 27 15:42:01.619130 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 551/1103] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:42:02.768591 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:02.769161 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:02.775096 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:02.775538 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:02.777000 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:02.777430 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:02.857332 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.objects.instance [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lazy-loading 'services' on Instance uuid 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c {{(pid=117869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 15:42:02.935072 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-d22c0d5e-f60f-46ac-84d2-5311114bb1da tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments/9a91905d-d6c6-4947-82d5-9efc13964c2a" status: 202 len: 0 microversion: 2.1 time: 0.170693 Jul 27 15:42:02.935666 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 553/1104] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:42:02 2022] DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments/9a91905d-d6c6-4947-82d5-9efc13964c2a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:42:02.945021 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:02.948396 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:02.956372 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:02.956819 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:02.957806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:02.958252 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:02.990083 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-af257aba-2d59-41fb-aa4c-40135c121382 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049797 Jul 27 15:42:02.990520 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 552/1105] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:42:02 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:42:03.634276 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [req-3a761e2d-4c39-4851-bf2e-644f31672944 req-7495b808-73ef-4656-970c-6187d88e2c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:42:03.644428 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-3a761e2d-4c39-4851-bf2e-644f31672944 req-7495b808-73ef-4656-970c-6187d88e2c45 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:03.645001 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [req-3a761e2d-4c39-4851-bf2e-644f31672944 req-7495b808-73ef-4656-970c-6187d88e2c45 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:03.809236 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.compute.server_external_events [req-3a761e2d-4c39-4851-bf2e-644f31672944 req-7495b808-73ef-4656-970c-6187d88e2c45 service nova] Creating event network-changed:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:42:03.813897 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [req-3a761e2d-4c39-4851-bf2e-644f31672944 req-7495b808-73ef-4656-970c-6187d88e2c45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183637 Jul 27 15:42:03.814516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 554/1106] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:42:04.002964 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:04.005040 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:04.011801 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:04.012267 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:04.013019 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:04.013445 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:04.043649 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-659d91b1-1fa5-4144-8549-5feabd822869 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044732 Jul 27 15:42:04.044247 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 553/1107] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Jul 27 15:42:03 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:42:04.055443 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:04.056193 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:04.062416 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:04.062923 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:04.063683 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:04.064167 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:04.144370 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] HTTP exception thrown: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c is not attached to volume 9a91905d-d6c6-4947-82d5-9efc13964c2a Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Request method failure captured: Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments/9a91905d-d6c6-4947-82d5-9efc13964c2a HTTP/1.1 Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VxQxyCkYjX94Xj-4yGmm5cb7Vx0VUYGurrMQXmh-i_gukNtijmjj5t7j235tOjcvzwDUm8oyfOmcas3Z4smLQWtGiejJ8qi-mrcnbVUpz4yEuwQxglLcWh9JSyj3jQaiUaRprhDelmdn2rOsk6CIY81PcwjNw1VfOWtBkmm0M9Wi5k Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: f40879b7ec11451a82501bf14592c04a Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-TestMinimumBasicScenario-1003999524 Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:42:04.146723 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40879b7ec11451a82501bf14592c04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40879b7ec11451a82501bf14592c04a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40879b7ec11451a82501bf14592c04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40879b7ec11451a82501bf14592c04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-TestMinimumBasicScenario-1003999524 Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: f40879b7ec11451a82501bf14592c04a Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1003999524 Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-TestMinimumBasicScenario-1003999524-project Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 658f2b944c994780b615b5c0affd4600 Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-TestMinimumBasicScenario-1003999524-project Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:42:04.148477 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c is not attached to volume 9a91905d-d6c6-4947-82d5-9efc13964c2a Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'server_id': '2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c', 'id': '9a91905d-d6c6-4947-82d5-9efc13964c2a'} Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9a91905d-d6c6-4947-82d5-9efc13964c2a. Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:42:04.153380 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c is not attached to volume 9a91905d-d6c6-4947-82d5-9efc13964c2a Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c is not attached to volume 9a91905d-d6c6-4947-82d5-9efc13964c2a Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:04.155045 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Returning 404 to user: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c is not attached to volume 9a91905d-d6c6-4947-82d5-9efc13964c2a {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:42:04.156708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-be83d3a7-dbd3-4e19-b8af-45ac4705045b tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments/9a91905d-d6c6-4947-82d5-9efc13964c2a" status: 404 len: 154 microversion: 2.1 time: 0.097047 Jul 27 15:42:04.156708 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 555/1108] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Jul 27 15:42:04 2022] DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c/os-volume_attachments/9a91905d-d6c6-4947-82d5-9efc13964c2a => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:42:05.288901 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:05.289397 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:05.296355 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:05.296800 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:05.297790 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:05.298228 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:05.322664 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 15:42:05.397041 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-212f0cb7-e2b2-4154-ad36-6eaf748ba1aa tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 204 len: 0 microversion: 2.1 time: 0.111761 Jul 27 15:42:05.397744 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 554/1109] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Jul 27 15:42:05 2022] DELETE /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:42:05.408061 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:05.408824 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:05.416016 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:05.417091 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:05.417963 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:05.418462 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:05.544529 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:42:05.552296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-7b21eadf-918f-4c10-b5d0-a5e9dc1117d4 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1555 microversion: 2.1 time: 0.149329 Jul 27 15:42:05.553145 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 556/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:42:05 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:42:06.573806 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:06.574502 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:06.581039 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:06.581481 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:06.582230 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:06.582656 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:06.714811 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:42:06.722436 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ab067e85-05af-481b-997d-f3a51bcd5715 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1555 microversion: 2.1 time: 0.152832 Jul 27 15:42:06.722996 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 555/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:42:06 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:42:07.743782 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:07.744948 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:07.751341 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:07.751858 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:07.752624 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:07.753056 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:07.921630 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.policy [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658f2b944c994780b615b5c0affd4600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40879b7ec11451a82501bf14592c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117869) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:42:07.929853 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-20478ca1-c3ac-4eb2-9f2e-9950b36c8f83 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 200 len: 1555 microversion: 2.1 time: 0.189888 Jul 27 15:42:07.930472 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 557/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:42:07 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:42:07.942413 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b9aaa29d-c46d-4a88-8245-e9020ae22f48 req-b61e3215-4c81-4ae7-8180-b9f986414cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c", "name": "network-vif-deleted", "tag": "6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:42:07.958031 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b9aaa29d-c46d-4a88-8245-e9020ae22f48 req-b61e3215-4c81-4ae7-8180-b9f986414cc5 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:07.958476 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b9aaa29d-c46d-4a88-8245-e9020ae22f48 req-b61e3215-4c81-4ae7-8180-b9f986414cc5 service nova] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:07.972300 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-b9aaa29d-c46d-4a88-8245-e9020ae22f48 req-b61e3215-4c81-4ae7-8180-b9f986414cc5 service nova] Creating event network-vif-deleted:6b1ab1bf-8bfa-4e2c-b7f2-920d83c68625 for instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c on hv-cinder-84131 Jul 27 15:42:07.978897 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b9aaa29d-c46d-4a88-8245-e9020ae22f48 req-b61e3215-4c81-4ae7-8180-b9f986414cc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039675 Jul 27 15:42:07.980468 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 556/1113] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jul 27 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:42:08.951180 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '>' {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:08.951737 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.compute.api [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] [instance: 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c] Fetching instance by UUID {{(pid=117869) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 15:42:08.958225 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:08.958668 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:08.959431 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 15:42:08.959883 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG oslo_concurrency.lockutils [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Lock "ad4132ff-22fa-42e9-8152-725bc0f0dfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 15:42:08.973522 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.wsgi [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] HTTP exception thrown: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c could not be found. Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Request method failure captured: Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: request: GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c HTTP/1.1 Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept: application/json Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Accept-Encoding: identity Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Connection: close Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Length: 0 Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Content-Type: application/json Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Host: 10.222.0.36 Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Openstack-System-Scope: None Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: User-Agent: python-urllib3/1.26.10 Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Auth-Token: gAAAAABi4VxQxyCkYjX94Xj-4yGmm5cb7Vx0VUYGurrMQXmh-i_gukNtijmjj5t7j235tOjcvzwDUm8oyfOmcas3Z4smLQWtGiejJ8qi-mrcnbVUpz4yEuwQxglLcWh9JSyj3jQaiUaRprhDelmdn2rOsk6CIY81PcwjNw1VfOWtBkmm0M9Wi5k Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Id: None Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Domain-Name: None Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Identity-Status: Confirmed Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Is-Admin-Project: True Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Id: default Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Domain-Name: Default Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Id: f40879b7ec11451a82501bf14592c04a Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Project-Name: tempest-TestMinimumBasicScenario-1003999524 Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Role: reader,member Jul 27 15:42:08.975036 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Roles: reader,member Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40879b7ec11451a82501bf14592c04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40879b7ec11451a82501bf14592c04a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40879b7ec11451a82501bf14592c04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40879b7ec11451a82501bf14592c04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant: tempest-TestMinimumBasicScenario-1003999524 Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Id: f40879b7ec11451a82501bf14592c04a Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1003999524 Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User: tempest-TestMinimumBasicScenario-1003999524-project Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Id: default Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Domain-Name: Default Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Id: 658f2b944c994780b615b5c0affd4600 Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: X-User-Name: tempest-TestMinimumBasicScenario-1003999524-project Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: method: > Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: exception: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c could not be found. Jul 27 15:42:08.976728 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: action_args: {'id': '2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c'} Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: {{(pid=117869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c could not be found. Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 15:42:08.977690 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c could not be found. Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c could not be found. Jul 27 15:42:08.979296 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: ERROR nova.api.openstack.wsgi Jul 27 15:42:08.980825 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: DEBUG nova.api.openstack.wsgi [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Returning 404 to user: Instance 2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c could not be found. {{(pid=117869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 15:42:08.980825 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO nova.api.openstack.requestlog [None req-ae1595c2-79fa-411a-a508-9afccb32dd06 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c" status: 404 len: 111 microversion: 2.1 time: 0.029819 Jul 27 15:42:08.980825 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: [pid: 117869|app: 0|req: 558/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Jul 27 15:42:08 2022] GET /compute/v2.1/servers/2cfeb7fe-92c6-4dc3-8181-3afcebe6d19c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:42:08.985592 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-82153dc0-8cc7-47d8-971b-38e548959a72 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] Calling method '.version_select at 0x7f9fd3d88dc0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:42:09.003695 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-82153dc0-8cc7-47d8-971b-38e548959a72 tempest-TestMinimumBasicScenario-1003999524 tempest-TestMinimumBasicScenario-1003999524-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1884849404" status: 202 len: 0 microversion: 2.1 time: 0.022274 Jul 27 15:42:09.004294 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 557/1115] 10.222.0.36 () {58 vars in 1272 bytes} [Wed Jul 27 15:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1884849404 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:43:39.064599 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:43:39.065711 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Wed Jul 27 15:43:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:43:51.239866 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:43:51.240427 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Wed Jul 27 15:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:44:10.471362 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:44:10.471999 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Wed Jul 27 15:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:45:24.140516 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:45:24.143595 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Wed Jul 27 15:45:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:45:24.686894 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:45:24.687484 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Wed Jul 27 15:45:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:46:59.074782 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:46:59.075359 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Wed Jul 27 15:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:47:11.248338 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:47:11.249444 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Wed Jul 27 15:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:47:19.244554 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:47:19.245179 dv-cinder-841315-2-iscsi devstack@n-api.service[117869]: Wed Jul 27 15:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:47:30.479333 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:47:30.479984 dv-cinder-841315-2-iscsi devstack@n-api.service[117870]: Wed Jul 27 15:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!